Jun 28 14:14:34 devstack cinder-volume[82469]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 28 14:14:34 devstack cinder-volume[82469]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 28 14:14:34 devstack cinder-volume[82469]: we strongly recommend against using it for new projects. Jun 28 14:14:34 devstack cinder-volume[82469]: If you are already using Eventlet, we recommend migrating to a different Jun 28 14:14:34 devstack cinder-volume[82469]: framework. For more detail see Jun 28 14:14:34 devstack cinder-volume[82469]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 28 14:14:34 devstack cinder-volume[82469]: import eventlet # noqa Jun 28 14:14:37 devstack cinder-volume[82469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82469) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 28 14:14:37 devstack cinder-volume[82469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82469) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 28 14:14:37 devstack cinder-volume[82469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82469) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 28 14:14:37 devstack cinder-volume[82469]: INFO dbcounter [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Registered counter for database cinder Jun 28 14:14:37 devstack cinder-volume[82469]: DEBUG oslo_db.sqlalchemy.engines [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82469) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 28 14:14:38 devstack cinder-volume[82469]: DEBUG dbcounter [-] [82469] Writer thread running {{(pid=82469) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 28 14:14:38 devstack cinder-volume[82469]: INFO cinder.rpc [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 28 14:14:38 devstack cinder-volume[82469]: INFO cinder.rpc [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 28 14:14:38 devstack cinder-volume[82469]: DEBUG oslo_db.sqlalchemy.engines [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82469) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 28 14:14:38 devstack cinder-volume[82469]: INFO cinder.volume.manager [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Determined volume DB was empty at startup. Jun 28 14:14:38 devstack cinder-volume[82469]: DEBUG cinder.volume.manager [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82469) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 28 14:14:38 devstack cinder-volume[82469]: INFO cinder.volume.manager [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 28 14:14:38 devstack cinder-volume[82469]: WARNING stevedore.named [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 28 14:14:38 devstack cinder-volume[82469]: WARNING castellan.key_manager [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 28 14:14:38 devstack cinder-volume[82469]: WARNING cinder.keymgr.conf_key_mgr [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 28 14:14:38 devstack cinder-volume[82469]: DEBUG cinder.volume.drivers.lvm [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82469) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 28 14:14:38 devstack cinder-volume[82469]: DEBUG oslo_concurrency.processutils [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82469) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:38 devstack cinder-volume[82469]: DEBUG oslo_concurrency.processutils [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.436s {{(pid=82469) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:38 devstack cinder-volume[82469]: DEBUG oslo_db.sqlalchemy.engines [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82469) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 28 14:14:38 devstack cinder-volume[82469]: INFO cinder.rpc [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 28 14:14:38 devstack cinder-volume[82469]: INFO cinder.rpc [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 28 14:14:38 devstack cinder-volume[82469]: WARNING stevedore.named [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 28 14:14:38 devstack cinder-volume[82469]: WARNING castellan.key_manager [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 28 14:14:38 devstack cinder-volume[82469]: INFO cinder.volume.manager [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_db.sqlalchemy.engines [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82469) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 28 14:14:39 devstack cinder-volume[82469]: INFO oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Starting 1 workers Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Started child 82649 {{(pid=82469) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Full set of CONF: {{(pid=82469) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] ******************************************************************************** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Configuration options gathered from: {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] ================================================================================ {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] allow_availability_zone_fallback = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82649]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] allow_compression_on_image_upload = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] allowed_direct_url_schemes = [] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] api_rate_limit = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] auth_strategy = keystone {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] az_cache_duration = 3600 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_availability_zone = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_host = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_name = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_stats_polling_interval = 60 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backup_api_class = cinder.backup.api.API {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backup_name_template = backup-%s {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backup_use_same_host = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backup_use_temp_snapshot = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] chap_password = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] chap_username = {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cinder_internal_tenant_project_id = 4a0d92b847114b7c976618174510a9d0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cinder_internal_tenant_user_id = abc045664bea44bbb13e9b8c8b10774e {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cloned_volume_same_az = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cluster = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] compression_format = gzip {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] compute_api_class = cinder.compute.nova.API {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] config_dir = [] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] config_source = [] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] control_exchange = openstack {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] debug = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] default_availability_zone = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] default_group_type = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] default_volume_type = lvmdriver-1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] disk_geometry = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] driver_client_cert = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] driver_client_cert_key = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] driver_data_namespace = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] driver_ssl_cert_path = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] driver_ssl_cert_verify = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] driver_use_ssl = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] enable_force_upload = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] enable_new_services = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] enable_unsupported_driver = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] enforce_multipath_for_image_xfer = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] filter_function = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance_api_insecure = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance_api_servers = ['http://192.168.122.160/image'] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance_api_ssl_compression = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance_ca_certificates_file = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance_catalog_info = image:glance:publicURL {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance_certfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance_keyfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance_num_retries = 3 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance_request_timeout = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] goodness_function = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] graceful_shutdown_timeout = 5 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] group_api_class = cinder.group.api.API {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] host = devstack {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] image_compress_on_upload = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] image_conversion_address_space_limit = 1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] image_conversion_cpu_limit = 60 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] image_conversion_disable = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] image_upload_use_cinder_backend = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] image_upload_use_internal_tenant = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] image_volume_cache_enabled = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] image_volume_cache_max_count = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack sudo[82654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] image_volume_cache_max_size_gb = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] init_host_max_objects_retrieval = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] instance_format = [instance: %(uuid)s] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] iscsi_target_flags = {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] iscsi_write_cache = on {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] iser_helper = tgtadm {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack sudo[82654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] iser_ip_address = 192.168.122.160 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] iser_port = 3260 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] log_color = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] log_config_append = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] log_dir = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] log_file = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] log_options = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] log_rotate_interval = 1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] log_rotate_interval_type = days {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] log_rotation_type = none {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82649]: INFO cinder.volume.manager [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 28 14:14:39 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] max_age = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] max_logfile_count = 30 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] max_logfile_size_mb = 200 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] max_over_subscription_ratio = 20.0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] message_reap_interval = 86400 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] message_ttl = 2592000 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] migration_create_volume_timeout_secs = 300 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] monkey_patch = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] monkey_patch_modules = [] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] my_ip = 192.168.122.160 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] no_snapshot_gb_quota = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] num_iser_scan_tries = 3 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] num_shell_tries = 3 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] num_volume_device_scan_tries = 3 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] nvmeof_conn_info_version = 1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] nvmet_ns_id = 10 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] nvmet_port_id = 1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] osapi_max_limit = 1000 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] osapi_volume_ext_list = [] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] osapi_volume_listen_port = 8776 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] osapi_volume_use_ssl = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] osapi_volume_workers = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] per_volume_size_limit = -1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] periodic_fuzzy_delay = 60 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] periodic_interval = 60 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] public_endpoint = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] publish_errors = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] quota_backup_gigabytes = 1000 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] quota_backups = 10 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] quota_gigabytes = 1000 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] quota_groups = 10 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] quota_snapshots = 10 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] quota_volumes = 10 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] rate_limit_burst = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] rate_limit_except_level = CRITICAL {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] rate_limit_interval = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] reinit_driver_count = 3 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] replication_device = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] report_discard_supported = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] report_interval = 120 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] reservation_clean_interval = 86400 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] reservation_expire = 86400 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] reserved_image_namespaces = [] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] reserved_percentage = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] rpc_response_timeout = 120 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] run_external_periodic_tasks = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] scst_target_driver = iscsi {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] scst_target_iqn_name = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] service_down_time = 720 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] shell_completion = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] snapshot_name_template = snapshot-%s {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] snapshot_same_host = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] split_loggers = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] state_path = /opt/stack/data/cinder {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] storage_availability_zone = nova {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] storage_protocol = iSCSI {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] syslog_log_facility = LOG_USER {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] target_helper = lioadm {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] target_ip_address = 192.168.122.160 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] target_port = 3260 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] target_protocol = iscsi {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] target_secondary_ip_addresses = [] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] trace_flags = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] transport_url = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:39 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] until_refresh = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] use_chap_auth = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] use_default_quota_class = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] use_journal = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] use_json = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] use_multipath_for_image_xfer = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] use_stderr = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] use_syslog = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] verify_glance_signatures = enabled {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] volume_api_class = cinder.volume.api.API {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] volume_backend_name = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] volume_clear = zero {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] volume_clear_ionice = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] volume_clear_size = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] volume_copy_bps_limit = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] volume_dd_blocksize = 1M {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] volume_name_template = volume-%s {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] volume_service_inithost_offload = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] volume_usage_audit_period = month {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] zoning_mode = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_concurrency.disable_process_locking = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.auth_section = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.auth_type = password {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.auth_version = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.cache = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.certfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.include_service_catalog = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.insecure = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.interface = public {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.keyfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_password = {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcache_username = {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.region_name = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.service_type = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.160/identity {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.backend = dogpile.cache.null {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.backend_argument = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.backend_expiration_time = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.config_prefix = cache.oslo {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.debug_cache_backend = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.enable_retry_client = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.enable_socket_keepalive = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.enabled = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.expiration_time = 600 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.hashclient_retry_attempts = 2 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.memcache_dead_retry = 300 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.memcache_pool_maxsize = 10 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.memcache_sasl_enabled = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.password = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.proxies = [] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.redis_db = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.redis_server = localhost:6379 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.retry_attempts = 2 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.retry_delay = 0.0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.socket_keepalive_count = 1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.socket_keepalive_idle = 1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.socket_keepalive_interval = 1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.socket_timeout = 1.0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.tls_allowed_ciphers = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.tls_cafile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.tls_certfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.tls_enabled = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.tls_keyfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cache.username = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] coordination.backend_url = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.asyncio_connection = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.asyncio_slave_connection = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.backend = sqlalchemy {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.connection = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.connection_debug = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.connection_parameters = {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.connection_recycle_time = 3600 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.connection_trace = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.db_inc_retry_interval = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.db_max_retries = 20 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.db_max_retry_interval = 10 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.db_retry_interval = 1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.max_overflow = 50 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.max_pool_size = 5 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.max_retries = 10 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.mysql_wsrep_sync_wait = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.pool_timeout = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.retry_interval = 10 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.slave_connection = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.sqlite_synchronous = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.synchronous_reader = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] database.use_db_reconnect = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] profiler.connection_string = messaging:// {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] profiler.enabled = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] profiler.es_doc_type = notification {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] profiler.es_scroll_size = 10000 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] profiler.es_scroll_time = 2m {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] profiler.filter_error_trace = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] profiler.hmac_keys = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] profiler.sentinel_service_name = mymaster {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] profiler.socket_timeout = 0.1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] profiler.trace_requests = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] profiler.trace_sqlalchemy = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] profiler_jaeger.process_tags = {} {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] profiler_jaeger.service_name_prefix = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] profiler_otlp.service_name_prefix = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_policy.enforce_new_defaults = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: WARNING oslo_config.cfg [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_policy.enforce_scope = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_policy.policy_default_rule = default {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_policy.policy_file = policy.yaml {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] privsep_osbrick.group = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] privsep_osbrick.helper_command = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] privsep_osbrick.user = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cinder_sys_admin.group = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cinder_sys_admin.helper_command = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] cinder_sys_admin.user = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] service_user.auth_section = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] service_user.auth_type = password {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] service_user.cafile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] service_user.certfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] service_user.collect_timing = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] service_user.insecure = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] service_user.keyfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] service_user.send_service_user_token = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] service_user.split_loggers = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] service_user.timeout = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance.auth_section = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance.auth_type = password {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance.certfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance.collect_timing = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance.insecure = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance.keyfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance.region_name = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance.split_loggers = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] glance.timeout = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.backend_availability_zone = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.chap_password = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.chap_username = {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.disk_geometry = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.driver_client_cert = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.driver_client_cert_key = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.driver_data_namespace = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.driver_use_ssl = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.extra_capabilities = {} {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.filter_function = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.goodness_function = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.iscsi_target_flags = {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.iscsi_write_cache = on {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.iser_helper = tgtadm {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.iser_ip_address = 192.168.122.160 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.iser_port = 3260 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.lvm_share_target = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.lvm_type = auto {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.num_shell_tries = 3 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.replication_device = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.report_discard_supported = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.reserved_percentage = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.target_helper = tgtadm {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.target_ip_address = 192.168.122.160 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.target_port = 3260 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.target_protocol = iscsi {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.trace_flags = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.unique_fqdn_network = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.use_chap_auth = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.volume_backend_name = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.volume_clear = zero {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.volume_clear_ionice = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.volume_clear_size = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_reports.file_event_handler = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_reports.log_dir = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.backend_host = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.chap_password = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.chap_username = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.disk_geometry = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.driver_client_cert = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.extra_capabilities = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.filter_function = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.goodness_function = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.iser_helper = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.iser_ip_address = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.iser_port = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.lvm_share_target = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.lvm_type = auto {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.num_shell_tries = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.replication_device = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.report_discard_supported = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.reserved_percentage = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.scst_target_driver = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.storage_protocol = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.target_helper = lioadm {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.target_ip_address = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.target_port = 3260 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.trace_flags = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.use_chap_auth = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.volume_clear = zero {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.volume_clear_size = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] lvmdriver-1.volumes_dir = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.ssl = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_notifications.driver = [] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_notifications.retry = -1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] key_manager.fixed_key = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.barbican_api_version = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.barbican_endpoint = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.barbican_endpoint_type = public {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.barbican_region_name = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.cafile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.certfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.collect_timing = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.insecure = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.keyfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.number_of_retries = 60 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.retry_delay = 1 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.send_service_user_token = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.split_loggers = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.timeout = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.verify_ssl = True {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican.verify_ssl_path = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican_service_user.auth_section = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican_service_user.auth_type = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican_service_user.cafile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican_service_user.certfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican_service_user.collect_timing = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican_service_user.insecure = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican_service_user.keyfile = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican_service_user.split_loggers = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] barbican_service_user.timeout = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] vault.approle_role_id = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] vault.approle_secret_id = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] vault.kv_mountpoint = secret {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] vault.kv_path = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] vault.kv_version = 2 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] vault.namespace = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] vault.root_token_id = **** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] vault.ssl_ca_crt_file = None {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] vault.timeout = 60.0 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] vault.use_ssl = False {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:14:39 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] ******************************************************************************** {{(pid=82469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 28 14:14:39 devstack sudo[82654]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:39 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.711s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:39 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:40 devstack sudo[82659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 28 14:14:40 devstack sudo[82659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:40 devstack sudo[82659]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:40 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.669s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:40 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:14:40 devstack cinder-volume[82649]: INFO cinder.brick.local_dev.lvm [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 28 14:14:40 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:40 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:40 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:40 devstack sudo[82939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 28 14:14:40 devstack sudo[82939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:41 devstack sudo[82939]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:41 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:41 devstack cinder-volume[82649]: DEBUG cinder.brick.local_dev.lvm [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82649) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 28 14:14:41 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:41 devstack sudo[83142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 28 14:14:41 devstack sudo[83142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:42 devstack sudo[83142]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:42 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.488s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:42 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:42 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:42 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:42 devstack sudo[83431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 28 14:14:42 devstack sudo[83431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:43 devstack sudo[83431]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:43 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.726s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:43 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:43 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:43 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:43 devstack sudo[83436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 28 14:14:43 devstack sudo[83436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:44 devstack sudo[83436]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:44 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.684s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:44 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:44 devstack sudo[83440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 28 14:14:44 devstack sudo[83440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:45 devstack sudo[83440]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:45 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.743s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:45 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:45 devstack sudo[83449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 28 14:14:45 devstack sudo[83449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:45 devstack sudo[83449]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:45 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.879s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:45 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:45 devstack sudo[83455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 28 14:14:45 devstack sudo[83455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:46 devstack sudo[83455]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:46 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.881s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:46 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:46 devstack sudo[83461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 28 14:14:46 devstack sudo[83461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:47 devstack sudo[83461]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:47 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.749s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:47 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:47 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:47 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:47 devstack sudo[83470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 28 14:14:47 devstack sudo[83470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:48 devstack sudo[83470]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:48 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.643s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:48 devstack cinder-volume[82649]: INFO cinder.volume.drivers.lvm [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 28 14:14:48 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:48 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:48 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:48 devstack sudo[83483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 28 14:14:48 devstack sudo[83483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:49 devstack sudo[83483]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:49 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.793s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:49 devstack cinder-volume[82649]: DEBUG cinder.volume.drivers.lvm [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Updating volume stats {{(pid=82649) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 28 14:14:49 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:49 devstack sudo[83597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 28 14:14:49 devstack sudo[83597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:49 devstack cinder-volume[82469]: DEBUG dbcounter [-] [82469] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82469) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:14:49 devstack sudo[83597]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:49 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:49 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:49 devstack sudo[83735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 28 14:14:49 devstack sudo[83735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:50 devstack sudo[83735]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:50 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:50 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:50 devstack sudo[83741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 28 14:14:50 devstack sudo[83741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:50 devstack sudo[83741]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.655s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:51 devstack sudo[83744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 28 14:14:51 devstack sudo[83744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:51 devstack sudo[83744]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:51 devstack cinder-volume[82649]: INFO cinder.volume.driver [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Driver hasn't implemented _init_vendor_properties() Jun 28 14:14:51 devstack cinder-volume[82649]: DEBUG cinder.volume.driver [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82649) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 28 14:14:51 devstack cinder-volume[82649]: DEBUG oslo_db.sqlalchemy.engines [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82649) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 28 14:14:51 devstack cinder-volume[82649]: DEBUG dbcounter [-] [82649] Writer thread running {{(pid=82649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 28 14:14:51 devstack cinder-volume[82649]: DEBUG cinder.db.api [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Building query based on filter {{(pid=82649) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 28 14:14:51 devstack cinder-volume[82649]: DEBUG cinder.image.image_utils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82649) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 28 14:14:51 devstack cinder-volume[82649]: INFO cinder.keymgr.migration [None req-def59fd3-3b5c-4e6c-85c2-029686b042aa None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 28 14:14:51 devstack cinder-volume[82649]: DEBUG cinder.volume.drivers.lvm [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Updating volume stats {{(pid=82649) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 28 14:14:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:51 devstack sudo[83752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 28 14:14:51 devstack sudo[83752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:52 devstack sudo[83752]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:52 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:52 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:52 devstack sudo[83756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 28 14:14:52 devstack sudo[83756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:53 devstack sudo[83756]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:53 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:53 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:53 devstack sudo[83759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 28 14:14:53 devstack sudo[83759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:53 devstack sudo[83759]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:53 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.661s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:53 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:53 devstack sudo[83763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 28 14:14:53 devstack sudo[83763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:54 devstack sudo[83763]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:54 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:54 devstack cinder-volume[82649]: DEBUG cinder.manager [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Notifying Schedulers of capabilities ... {{(pid=82649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:14:54 devstack cinder-volume[82649]: INFO cinder.volume.manager [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Driver initialization completed successfully. Jun 28 14:14:54 devstack cinder-volume[82649]: INFO cinder.manager [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Initiating service 2 cleanup Jun 28 14:14:54 devstack cinder-volume[82649]: INFO cinder.manager [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Service 2 cleanup completed. Jun 28 14:14:54 devstack cinder-volume[82649]: DEBUG cinder.service [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Creating RPC server for service cinder-volume {{(pid=82649) start /opt/stack/cinder/cinder/service.py:231}} Jun 28 14:14:54 devstack cinder-volume[82649]: DEBUG cinder.service [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82649) start /opt/stack/cinder/cinder/service.py:237}} Jun 28 14:14:54 devstack cinder-volume[82649]: INFO cinder.volume.manager [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 28 14:14:54 devstack cinder-volume[82649]: DEBUG cinder.volume.drivers.lvm [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Updating volume stats {{(pid=82649) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 28 14:14:54 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:54 devstack sudo[83767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 28 14:14:54 devstack sudo[83767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:55 devstack sudo[83767]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:55 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:55 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:55 devstack sudo[83774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 28 14:14:55 devstack sudo[83774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:56 devstack sudo[83774]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:56 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:56 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:56 devstack sudo[83777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 28 14:14:56 devstack sudo[83777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:56 devstack sudo[83777]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:56 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.620s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:56 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:14:56 devstack sudo[83834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 28 14:14:56 devstack sudo[83834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:14:57 devstack sudo[83834]: pam_unix(sudo:session): session closed for user root Jun 28 14:14:57 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:14:57 devstack cinder-volume[82649]: INFO cinder.volume.manager [None req-a766eea2-4385-48e5-b045-1c94a5bcaf3c None None] Driver post RPC initialization completed successfully. Jun 28 14:15:07 devstack cinder-volume[82649]: DEBUG dbcounter [-] [82649] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:15:07 devstack cinder-volume[82649]: DEBUG dbcounter [-] [82649] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=82649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:15:49 devstack cinder-volume[82649]: DEBUG oslo_service.periodic_task [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:15:49 devstack cinder-volume[82649]: DEBUG cinder.volume.drivers.lvm [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Updating volume stats {{(pid=82649) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 28 14:15:49 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:15:49 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 28 14:15:49 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:15:49 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Jun 28 14:15:49 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:15:49 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:15:49 devstack sudo[85528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 28 14:15:49 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:15:50 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root Jun 28 14:15:50 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:15:50 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:15:50 devstack sudo[85531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 28 14:15:50 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:15:51 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root Jun 28 14:15:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:15:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:15:51 devstack sudo[85552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 28 14:15:51 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:15:51 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root Jun 28 14:15:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:15:51 devstack cinder-volume[82649]: DEBUG cinder.manager [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Notifying Schedulers of capabilities ... {{(pid=82649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:15:51 devstack cinder-volume[82649]: DEBUG oslo_service.periodic_task [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running periodic task VolumeManager._thread_info {{(pid=82649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:15:51 devstack cinder-volume[82649]: DEBUG cinder.volume.manager [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] thread count: 6 {{(pid=82649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:15:51 devstack cinder-volume[82649]: DEBUG cinder.volume.manager [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] thread info: [<_MainThread(MainThread, started 134612135116928)>, , , , , ] {{(pid=82649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:16:49 devstack cinder-volume[82649]: DEBUG oslo_service.periodic_task [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:16:49 devstack cinder-volume[82649]: DEBUG cinder.volume.drivers.lvm [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Updating volume stats {{(pid=82649) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 28 14:16:49 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:16:49 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 28 14:16:49 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:16:49 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Jun 28 14:16:49 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:16:49 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:16:49 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 28 14:16:49 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:16:50 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Jun 28 14:16:50 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:16:50 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:16:50 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 28 14:16:50 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:16:51 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Jun 28 14:16:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.608s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:16:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:16:51 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 28 14:16:51 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:16:51 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Jun 28 14:16:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:16:51 devstack cinder-volume[82649]: DEBUG cinder.manager [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Notifying Schedulers of capabilities ... {{(pid=82649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:16:51 devstack cinder-volume[82649]: DEBUG oslo_service.periodic_task [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running periodic task VolumeManager._thread_info {{(pid=82649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:16:51 devstack cinder-volume[82649]: DEBUG cinder.volume.manager [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] thread count: 6 {{(pid=82649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:16:51 devstack cinder-volume[82649]: DEBUG cinder.volume.manager [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] thread info: [<_MainThread(MainThread, started 134612135116928)>, , , , , ] {{(pid=82649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:17:07 devstack cinder-volume[82649]: DEBUG dbcounter [-] [82649] Writing DB stats cinder:SELECT=1 {{(pid=82649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:17:07 devstack cinder-volume[82649]: DEBUG dbcounter [-] [82649] Writing DB stats cinder:UPDATE=1 {{(pid=82649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:17:49 devstack cinder-volume[82649]: DEBUG oslo_service.periodic_task [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:17:49 devstack cinder-volume[82649]: DEBUG cinder.volume.drivers.lvm [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Updating volume stats {{(pid=82649) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 28 14:17:49 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:17:49 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 28 14:17:49 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:17:49 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Jun 28 14:17:49 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:17:49 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:17:50 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 28 14:17:50 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:17:50 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Jun 28 14:17:50 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:17:50 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:17:50 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 28 14:17:50 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:17:51 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Jun 28 14:17:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:17:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:17:51 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 28 14:17:51 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:17:51 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Jun 28 14:17:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:17:51 devstack cinder-volume[82649]: DEBUG cinder.manager [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Notifying Schedulers of capabilities ... {{(pid=82649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:18:49 devstack cinder-volume[82649]: DEBUG oslo_service.periodic_task [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:18:49 devstack cinder-volume[82649]: DEBUG cinder.volume.drivers.lvm [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Updating volume stats {{(pid=82649) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 28 14:18:49 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:18:49 devstack sudo[91595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 28 14:18:49 devstack sudo[91595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:18:50 devstack sudo[91595]: pam_unix(sudo:session): session closed for user root Jun 28 14:18:50 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:18:50 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:18:50 devstack sudo[91640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 28 14:18:50 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:18:50 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root Jun 28 14:18:50 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:18:50 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:18:50 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 28 14:18:50 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:18:51 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Jun 28 14:18:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.666s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:18:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:18:51 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 28 14:18:51 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:18:51 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Jun 28 14:18:51 devstack cinder-volume[82649]: DEBUG oslo_concurrency.processutils [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=82649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:18:51 devstack cinder-volume[82649]: DEBUG cinder.manager [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Notifying Schedulers of capabilities ... {{(pid=82649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:18:51 devstack cinder-volume[82649]: DEBUG oslo_service.periodic_task [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] Running periodic task VolumeManager._thread_info {{(pid=82649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:18:51 devstack cinder-volume[82649]: DEBUG cinder.volume.manager [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] thread count: 6 {{(pid=82649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:18:51 devstack cinder-volume[82649]: DEBUG cinder.volume.manager [None req-4224e171-47ec-49b1-bee6-aed3c775410a None None] thread info: [<_MainThread(MainThread, started 134612135116928)>, , , , , ] {{(pid=82649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:19:07 devstack cinder-volume[82649]: DEBUG dbcounter [-] [82649] Writing DB stats cinder:SELECT=1 {{(pid=82649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:19:07 devstack cinder-volume[82649]: DEBUG dbcounter [-] [82649] Writing DB stats cinder:UPDATE=1 {{(pid=82649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:19:37 devstack cinder-volume[82469]: INFO oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Caught SIGTERM, stopping children Jun 28 14:19:37 devstack cinder-volume[82469]: DEBUG oslo_concurrency.lockutils [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Acquiring lock "singleton_lock" {{(pid=82469) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 28 14:19:37 devstack cinder-volume[82469]: DEBUG oslo_concurrency.lockutils [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Acquired lock "singleton_lock" {{(pid=82469) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 28 14:19:37 devstack cinder-volume[82469]: DEBUG oslo_concurrency.lockutils [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Releasing lock "singleton_lock" {{(pid=82469) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 28 14:19:37 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Stop services. {{(pid=82469) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 28 14:19:37 devstack cinder-volume[82469]: DEBUG oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Killing children. {{(pid=82469) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 28 14:19:37 devstack cinder-volume[82469]: INFO oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Waiting on 1 children to exit Jun 28 14:19:39 devstack cinder-volume[82649]: DEBUG oslo_concurrency.lockutils [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Acquiring lock "singleton_lock" {{(pid=82649) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 28 14:19:39 devstack cinder-volume[82649]: DEBUG oslo_concurrency.lockutils [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Acquired lock "singleton_lock" {{(pid=82649) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 28 14:19:39 devstack cinder-volume[82649]: DEBUG oslo_concurrency.lockutils [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Releasing lock "singleton_lock" {{(pid=82649) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 28 14:19:39 devstack cinder-volume[82649]: WARNING amqp [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 28 14:19:39 devstack cinder-volume[82649]: WARNING amqp [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 28 14:19:39 devstack cinder-volume[82469]: INFO oslo_service.backend._eventlet.service [None req-3ee2fb5f-be0f-46a7-b95e-191171a7b1a7 None None] Child 82649 exited with status 0 Jun 28 14:19:40 devstack cinder-volume[92746]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 28 14:19:40 devstack cinder-volume[92746]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 28 14:19:40 devstack cinder-volume[92746]: we strongly recommend against using it for new projects. Jun 28 14:19:40 devstack cinder-volume[92746]: If you are already using Eventlet, we recommend migrating to a different Jun 28 14:19:40 devstack cinder-volume[92746]: framework. For more detail see Jun 28 14:19:40 devstack cinder-volume[92746]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 28 14:19:40 devstack cinder-volume[92746]: import eventlet # noqa Jun 28 14:19:42 devstack cinder-volume[92746]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 28 14:19:42 devstack cinder-volume[92746]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 28 14:19:42 devstack cinder-volume[92746]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 28 14:19:42 devstack cinder-volume[92746]: INFO dbcounter [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Registered counter for database cinder Jun 28 14:19:42 devstack cinder-volume[92746]: DEBUG oslo_db.sqlalchemy.engines [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG dbcounter [-] [92746] Writer thread running {{(pid=92746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 28 14:19:43 devstack cinder-volume[92746]: INFO cinder.rpc [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 28 14:19:43 devstack cinder-volume[92746]: INFO cinder.rpc [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_db.sqlalchemy.engines [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 28 14:19:43 devstack cinder-volume[92746]: INFO cinder.volume.manager [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Determined volume DB was empty at startup. Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG cinder.volume.manager [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92746) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 28 14:19:43 devstack cinder-volume[92746]: INFO cinder.volume.manager [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 28 14:19:43 devstack cinder-volume[92746]: WARNING stevedore.named [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 28 14:19:43 devstack cinder-volume[92746]: WARNING castellan.key_manager [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 28 14:19:43 devstack cinder-volume[92746]: WARNING cinder.keymgr.conf_key_mgr [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 28 14:19:43 devstack cinder-volume[92746]: INFO cinder.volume.manager [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_db.sqlalchemy.engines [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 28 14:19:43 devstack cinder-volume[92746]: INFO oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Starting 1 workers Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Started child 92962 {{(pid=92746) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Full set of CONF: {{(pid=92746) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] ******************************************************************************** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Configuration options gathered from: {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] ================================================================================ {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] allow_availability_zone_fallback = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] allow_compression_on_image_upload = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] allowed_direct_url_schemes = [] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] api_rate_limit = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] auth_strategy = keystone {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_availability_zone = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_host = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_name = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92962]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_stats_polling_interval = 60 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backup_api_class = cinder.backup.api.API {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backup_name_template = backup-%s {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backup_use_same_host = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backup_use_temp_snapshot = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] chap_password = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] chap_username = {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cinder_internal_tenant_project_id = 4a0d92b847114b7c976618174510a9d0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cinder_internal_tenant_user_id = abc045664bea44bbb13e9b8c8b10774e {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cluster = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] compression_format = gzip {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] compute_api_class = cinder.compute.nova.API {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] config_dir = [] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] config_source = [] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] control_exchange = openstack {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] debug = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] default_availability_zone = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] default_group_type = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] default_volume_type = QuobyteHD {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] disk_geometry = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] driver_client_cert = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] driver_client_cert_key = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] driver_data_namespace = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] driver_ssl_cert_path = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] driver_ssl_cert_verify = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] driver_use_ssl = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] enable_new_services = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] enable_unsupported_driver = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] enabled_backends = ['QuobyteHD'] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] enforce_multipath_for_image_xfer = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] filter_function = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance_api_insecure = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance_api_servers = ['http://192.168.122.160/image'] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance_api_ssl_compression = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance_ca_certificates_file = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance_catalog_info = image:glance:publicURL {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance_certfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance_keyfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance_num_retries = 3 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance_request_timeout = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] goodness_function = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] graceful_shutdown_timeout = 5 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] group_api_class = cinder.group.api.API {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] host = devstack {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] image_compress_on_upload = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] image_conversion_address_space_limit = 1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] image_conversion_cpu_limit = 60 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] image_conversion_disable = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] image_upload_use_cinder_backend = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] image_upload_use_internal_tenant = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] image_volume_cache_enabled = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] image_volume_cache_max_count = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] image_volume_cache_max_size_gb = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] init_host_max_objects_retrieval = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] instance_format = [instance: %(uuid)s] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] iscsi_target_flags = {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] iscsi_write_cache = on {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] iser_helper = tgtadm {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] iser_ip_address = 192.168.122.160 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] iser_port = 3260 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] log_color = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] log_config_append = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] log_dir = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] log_file = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] log_options = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] log_rotate_interval = 1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] log_rotate_interval_type = days {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] log_rotation_type = none {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] max_age = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] max_logfile_count = 30 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] max_logfile_size_mb = 200 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] max_over_subscription_ratio = 20.0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] message_reap_interval = 86400 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] message_ttl = 2592000 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] migration_create_volume_timeout_secs = 300 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] monkey_patch = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] monkey_patch_modules = [] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] my_ip = 192.168.122.160 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] no_snapshot_gb_quota = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] num_iser_scan_tries = 3 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] num_shell_tries = 3 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] num_volume_device_scan_tries = 3 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] nvmeof_conn_info_version = 1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] nvmet_ns_id = 10 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] nvmet_port_id = 1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] osapi_max_limit = 1000 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] osapi_volume_ext_list = [] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] osapi_volume_listen_port = 8776 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] osapi_volume_use_ssl = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] osapi_volume_workers = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] per_volume_size_limit = -1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] periodic_fuzzy_delay = 60 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] periodic_interval = 60 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] public_endpoint = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] publish_errors = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] quota_backup_gigabytes = 1000 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] quota_backups = 10 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] quota_gigabytes = 1000 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] quota_groups = 10 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] quota_snapshots = 10 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] quota_volumes = 10 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] rate_limit_burst = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] rate_limit_except_level = CRITICAL {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] rate_limit_interval = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] reinit_driver_count = 3 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] replication_device = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] report_discard_supported = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] report_interval = 120 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] reservation_clean_interval = 86400 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] reservation_expire = 86400 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] reserved_image_namespaces = [] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] reserved_percentage = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] rpc_response_timeout = 120 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] run_external_periodic_tasks = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] scst_target_driver = iscsi {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] scst_target_iqn_name = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] service_down_time = 720 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] shell_completion = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] snapshot_name_template = snapshot-%s {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] split_loggers = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] state_path = /opt/stack/data/cinder {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] storage_availability_zone = nova {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] storage_protocol = iSCSI {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] syslog_log_facility = LOG_USER {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] target_helper = lioadm {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] target_ip_address = 192.168.122.160 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] target_port = 3260 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] target_protocol = iscsi {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] target_secondary_ip_addresses = [] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] trace_flags = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] transport_url = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] until_refresh = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] use_chap_auth = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] use_default_quota_class = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] use_journal = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] use_json = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] use_multipath_for_image_xfer = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] use_stderr = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] use_syslog = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] verify_glance_signatures = enabled {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] volume_api_class = cinder.volume.api.API {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] volume_backend_name = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] volume_clear = zero {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] volume_clear_ionice = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] volume_clear_size = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] volume_copy_bps_limit = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] volume_dd_blocksize = 1M {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] volume_name_template = volume-%s {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] volume_service_inithost_offload = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] volume_usage_audit_period = month {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] zoning_mode = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_concurrency.disable_process_locking = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92962]: INFO cinder.volume.manager [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 28 14:19:43 devstack cinder-volume[92962]: DEBUG cinder.volume.drivers.remotefs [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92962) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.auth_section = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.auth_type = password {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.auth_version = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.cache = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.certfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.include_service_catalog = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.insecure = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.interface = public {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.keyfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_password = {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcache_username = {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.region_name = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.service_type = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.160/identity {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.backend = dogpile.cache.null {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.backend_argument = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.backend_expiration_time = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.config_prefix = cache.oslo {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.debug_cache_backend = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.enable_retry_client = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.enable_socket_keepalive = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.enabled = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.expiration_time = 600 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.hashclient_retry_attempts = 2 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.memcache_dead_retry = 300 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.memcache_pool_maxsize = 10 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.memcache_sasl_enabled = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.password = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.proxies = [] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.redis_db = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.redis_server = localhost:6379 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.retry_attempts = 2 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.retry_delay = 0.0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.socket_keepalive_count = 1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.socket_keepalive_idle = 1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.socket_keepalive_interval = 1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.socket_timeout = 1.0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.tls_allowed_ciphers = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.tls_cafile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.tls_certfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.tls_enabled = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.tls_keyfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cache.username = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] coordination.backend_url = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.asyncio_connection = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.asyncio_slave_connection = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.backend = sqlalchemy {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.connection = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.connection_debug = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.connection_parameters = {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.connection_recycle_time = 3600 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.connection_trace = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.db_inc_retry_interval = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.db_max_retries = 20 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.db_max_retry_interval = 10 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.db_retry_interval = 1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.max_overflow = 50 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.max_pool_size = 5 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.max_retries = 10 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.mysql_wsrep_sync_wait = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.pool_timeout = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.retry_interval = 10 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.slave_connection = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.sqlite_synchronous = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.synchronous_reader = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] database.use_db_reconnect = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] profiler.connection_string = messaging:// {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] profiler.enabled = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] profiler.es_doc_type = notification {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] profiler.es_scroll_size = 10000 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] profiler.es_scroll_time = 2m {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] profiler.filter_error_trace = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] profiler.hmac_keys = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] profiler.sentinel_service_name = mymaster {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] profiler.socket_timeout = 0.1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] profiler.trace_requests = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] profiler.trace_sqlalchemy = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] profiler_jaeger.process_tags = {} {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] profiler_jaeger.service_name_prefix = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] profiler_otlp.service_name_prefix = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_policy.enforce_new_defaults = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: WARNING oslo_config.cfg [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_policy.enforce_scope = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_policy.policy_default_rule = default {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_policy.policy_file = policy.yaml {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] privsep_osbrick.group = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] privsep_osbrick.helper_command = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] privsep_osbrick.user = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cinder_sys_admin.group = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cinder_sys_admin.helper_command = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] cinder_sys_admin.user = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] service_user.auth_section = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] service_user.auth_type = password {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] service_user.cafile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] service_user.certfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] service_user.collect_timing = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] service_user.insecure = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] service_user.keyfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] service_user.send_service_user_token = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] service_user.split_loggers = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] service_user.timeout = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance.auth_section = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance.auth_type = password {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance.certfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance.collect_timing = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance.insecure = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance.keyfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance.region_name = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance.split_loggers = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] glance.timeout = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.backend_availability_zone = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.chap_password = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.chap_username = {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.disk_geometry = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.driver_client_cert = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.driver_client_cert_key = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.driver_data_namespace = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.driver_use_ssl = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.extra_capabilities = {} {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.filter_function = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.goodness_function = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.iscsi_target_flags = {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.iscsi_write_cache = on {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.iser_helper = tgtadm {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.iser_ip_address = 192.168.122.160 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.iser_port = 3260 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.nas_host = {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.nas_login = admin {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.nas_mount_options = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.nas_password = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.nas_private_key = {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.nas_share_path = {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.num_shell_tries = 3 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.quobyte_volume_url = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.replication_device = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.report_discard_supported = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.reserved_percentage = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.target_helper = tgtadm {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.target_ip_address = 192.168.122.160 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.target_port = 3260 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.target_protocol = iscsi {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.trace_flags = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.unique_fqdn_network = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.use_chap_auth = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.volume_backend_name = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.volume_clear = zero {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.volume_clear_ionice = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.volume_clear_size = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_reports.file_event_handler = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_reports.log_dir = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.backend_availability_zone = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.backend_host = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.chap_password = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.chap_username = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.chiscsi_conf = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.disk_geometry = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.driver_client_cert = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.driver_data_namespace = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.driver_use_ssl = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.extra_capabilities = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.filter_function = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92962]: DEBUG cinder.volume.drivers.quobyte [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92962) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.goodness_function = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92962]: WARNING cinder.volume.drivers.quobyte [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92962]: WARNING cinder.volume.drivers.quobyte [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92962]: DEBUG oslo_concurrency.processutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Running cmd (subprocess): mount.quobyte {{(pid=92962) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.iser_helper = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.iser_ip_address = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.iser_port = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.iser_target_prefix = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.nas_host = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.nas_login = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.nas_mount_options = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.nas_password = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.nas_private_key = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.nas_share_path = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.nas_ssh_port = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.num_shell_tries = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.nvmet_port_id = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.replication_device = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.report_discard_supported = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.reserved_percentage = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.scst_target_driver = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.storage_protocol = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.target_helper = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.target_ip_address = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.target_port = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.target_prefix = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.target_protocol = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.trace_flags = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.use_chap_auth = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.volume_clear = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.volume_clear_size = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] QuobyteHD.volumes_dir = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.ssl = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_notifications.driver = [] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_notifications.retry = -1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] key_manager.fixed_key = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.barbican_api_version = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.barbican_endpoint = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.barbican_endpoint_type = public {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.barbican_region_name = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.cafile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.certfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.collect_timing = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.insecure = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.keyfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.number_of_retries = 60 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.retry_delay = 1 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.send_service_user_token = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.split_loggers = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.timeout = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.verify_ssl = True {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican.verify_ssl_path = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican_service_user.auth_section = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican_service_user.auth_type = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican_service_user.cafile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican_service_user.certfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican_service_user.collect_timing = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican_service_user.insecure = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican_service_user.keyfile = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican_service_user.split_loggers = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] barbican_service_user.timeout = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] vault.approle_role_id = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] vault.approle_secret_id = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] vault.kv_mountpoint = secret {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] vault.kv_path = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] vault.kv_version = 2 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] vault.namespace = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] vault.root_token_id = **** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] vault.ssl_ca_crt_file = None {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] vault.timeout = 60.0 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] vault.use_ssl = False {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:19:43 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] ******************************************************************************** {{(pid=92746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 28 14:19:43 devstack quobyte-client[92967]: Reading configuration file: /etc/quobyte/client.cfg Jun 28 14:19:43 devstack quobyte-client[92967]: Invalid parameters found, error: missing mount point. Jun 28 14:19:43 devstack quobyte-client[92967]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 28 14:19:43 devstack quobyte-client[92967]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 28 14:19:43 devstack cinder-volume[92962]: DEBUG oslo_concurrency.processutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] CMD "mount.quobyte" returned: 1 in 0.093s {{(pid=92962) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:19:43 devstack cinder-volume[92962]: DEBUG oslo_concurrency.lockutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92962) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:19:43 devstack cinder-volume[92962]: DEBUG oslo_concurrency.lockutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92962) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:19:43 devstack cinder-volume[92962]: DEBUG cinder.volume.drivers.quobyte [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=92962) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:19:43 devstack cinder-volume[92962]: INFO cinder.volume.drivers.quobyte [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb ... Jun 28 14:19:43 devstack cinder-volume[92962]: DEBUG oslo_concurrency.processutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 -c /etc/quobyte/client-cinder.cfg {{(pid=92962) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:19:43 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 -c /etc/quobyte/client-cinder.cfg Jun 28 14:19:43 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:19:44 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Jun 28 14:19:44 devstack cinder-volume[92962]: DEBUG oslo_concurrency.processutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.778s {{(pid=92962) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:19:44 devstack cinder-volume[92962]: INFO cinder.volume.drivers.quobyte [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb succeeded Jun 28 14:19:44 devstack cinder-volume[92962]: DEBUG cinder.volume.drivers.quobyte [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=92962) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:19:44 devstack cinder-volume[92962]: DEBUG oslo_concurrency.lockutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.795s {{(pid=92962) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:19:44 devstack cinder-volume[92962]: DEBUG oslo_concurrency.processutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=92962) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:19:44 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:19:44 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:19:45 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Jun 28 14:19:45 devstack cinder-volume[92962]: DEBUG oslo_concurrency.processutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.611s {{(pid=92962) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:19:45 devstack cinder-volume[92962]: INFO cinder.volume.driver [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Driver hasn't implemented _init_vendor_properties() Jun 28 14:19:45 devstack cinder-volume[92962]: DEBUG cinder.volume.driver [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7280464172363, 'free_capacity_gb': 1775.7280464172363, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92962) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 28 14:19:45 devstack cinder-volume[92962]: DEBUG oslo_db.sqlalchemy.engines [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92962) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 28 14:19:45 devstack cinder-volume[92962]: DEBUG dbcounter [-] [92962] Writer thread running {{(pid=92962) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 28 14:19:45 devstack cinder-volume[92962]: DEBUG cinder.db.api [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Building query based on filter {{(pid=92962) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 28 14:19:45 devstack cinder-volume[92962]: DEBUG cinder.image.image_utils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92962) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 28 14:19:45 devstack cinder-volume[92962]: INFO cinder.keymgr.migration [None req-490f9c36-97ab-4881-9a32-42b6923694ce None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 28 14:19:45 devstack cinder-volume[92962]: DEBUG oslo_concurrency.lockutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92962) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:19:45 devstack cinder-volume[92962]: DEBUG oslo_concurrency.lockutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92962) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:19:45 devstack cinder-volume[92962]: DEBUG cinder.volume.drivers.quobyte [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=92962) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:19:45 devstack cinder-volume[92962]: DEBUG cinder.volume.drivers.quobyte [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=92962) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:19:45 devstack cinder-volume[92962]: DEBUG oslo_concurrency.lockutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92962) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:19:45 devstack cinder-volume[92962]: DEBUG oslo_concurrency.processutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=92962) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:19:45 devstack sudo[93040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:19:45 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:19:46 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root Jun 28 14:19:46 devstack cinder-volume[92962]: DEBUG oslo_concurrency.processutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.606s {{(pid=92962) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:19:46 devstack cinder-volume[92962]: DEBUG cinder.manager [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Notifying Schedulers of capabilities ... {{(pid=92962) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:19:46 devstack cinder-volume[92962]: INFO cinder.volume.manager [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Driver initialization completed successfully. Jun 28 14:19:46 devstack cinder-volume[92962]: INFO cinder.manager [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Initiating service 3 cleanup Jun 28 14:19:46 devstack cinder-volume[92962]: INFO cinder.manager [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Service 3 cleanup completed. Jun 28 14:19:46 devstack cinder-volume[92962]: DEBUG cinder.service [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Creating RPC server for service cinder-volume {{(pid=92962) start /opt/stack/cinder/cinder/service.py:231}} Jun 28 14:19:46 devstack cinder-volume[92962]: DEBUG cinder.service [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92962) start /opt/stack/cinder/cinder/service.py:237}} Jun 28 14:19:46 devstack cinder-volume[92962]: INFO cinder.volume.manager [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 28 14:19:46 devstack cinder-volume[92962]: DEBUG oslo_concurrency.lockutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92962) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:19:46 devstack cinder-volume[92962]: DEBUG oslo_concurrency.lockutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92962) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:19:46 devstack cinder-volume[92962]: DEBUG cinder.volume.drivers.quobyte [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=92962) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:19:46 devstack cinder-volume[92962]: DEBUG cinder.volume.drivers.quobyte [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=92962) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:19:46 devstack cinder-volume[92962]: DEBUG oslo_concurrency.lockutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92962) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:19:46 devstack cinder-volume[92962]: DEBUG oslo_concurrency.processutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=92962) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:19:46 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:19:46 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:19:46 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Jun 28 14:19:46 devstack cinder-volume[92962]: DEBUG oslo_concurrency.processutils [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.727s {{(pid=92962) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:19:46 devstack cinder-volume[92962]: INFO cinder.volume.manager [None req-a051601d-dc46-4ec9-b39e-88629e2c5fc5 None None] Driver post RPC initialization completed successfully. Jun 28 14:19:50 devstack cinder-volume[92962]: DEBUG oslo_concurrency.lockutils [None req-1d38983f-5121-4061-8cfd-c14d5e21aa20 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92962) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:19:50 devstack cinder-volume[92962]: DEBUG oslo_concurrency.lockutils [None req-1d38983f-5121-4061-8cfd-c14d5e21aa20 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92962) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:19:50 devstack cinder-volume[92962]: DEBUG cinder.volume.drivers.quobyte [None req-1d38983f-5121-4061-8cfd-c14d5e21aa20 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=92962) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:19:50 devstack cinder-volume[92962]: DEBUG cinder.volume.drivers.quobyte [None req-1d38983f-5121-4061-8cfd-c14d5e21aa20 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=92962) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:19:50 devstack cinder-volume[92962]: DEBUG oslo_concurrency.lockutils [None req-1d38983f-5121-4061-8cfd-c14d5e21aa20 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92962) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:19:50 devstack cinder-volume[92962]: DEBUG oslo_concurrency.processutils [None req-1d38983f-5121-4061-8cfd-c14d5e21aa20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=92962) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:19:50 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:19:50 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:19:51 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Jun 28 14:19:51 devstack cinder-volume[92962]: DEBUG oslo_concurrency.processutils [None req-1d38983f-5121-4061-8cfd-c14d5e21aa20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.597s {{(pid=92962) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:19:51 devstack cinder-volume[92962]: DEBUG cinder.manager [None req-1d38983f-5121-4061-8cfd-c14d5e21aa20 None None] Notifying Schedulers of capabilities ... {{(pid=92962) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:19:53 devstack cinder-volume[92746]: INFO oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Caught SIGTERM, stopping children Jun 28 14:19:53 devstack cinder-volume[92746]: DEBUG oslo_concurrency.lockutils [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Acquiring lock "singleton_lock" {{(pid=92746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 28 14:19:53 devstack cinder-volume[92746]: DEBUG oslo_concurrency.lockutils [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Acquired lock "singleton_lock" {{(pid=92746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 28 14:19:53 devstack cinder-volume[92746]: DEBUG oslo_concurrency.lockutils [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Releasing lock "singleton_lock" {{(pid=92746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 28 14:19:53 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Stop services. {{(pid=92746) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 28 14:19:53 devstack cinder-volume[92746]: DEBUG oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Killing children. {{(pid=92746) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 28 14:19:53 devstack cinder-volume[92746]: INFO oslo_service.backend._eventlet.service [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Waiting on 1 children to exit Jun 28 14:19:56 devstack cinder-volume[92962]: DEBUG dbcounter [-] [92962] Writing DB stats cinder:SELECT=4 {{(pid=92962) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:19:57 devstack cinder-volume[92962]: DEBUG dbcounter [-] [92962] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=92962) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:19:57 devstack cinder-volume[92962]: DEBUG oslo_service.periodic_task [None req-216edeb4-9fe1-48ce-aec3-d6129c8e154d None None] Running periodic task VolumeManager._thread_info {{(pid=92962) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:19:57 devstack cinder-volume[92962]: DEBUG cinder.volume.manager [None req-216edeb4-9fe1-48ce-aec3-d6129c8e154d None None] thread count: 6 {{(pid=92962) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:19:57 devstack cinder-volume[92962]: DEBUG cinder.volume.manager [None req-216edeb4-9fe1-48ce-aec3-d6129c8e154d None None] thread info: [<_MainThread(MainThread, started 123373620785280)>, , , , , ] {{(pid=92962) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:19:58 devstack cinder-volume[92962]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 28 14:19:58 devstack cinder-volume[93255]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 28 14:19:58 devstack cinder-volume[93255]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 28 14:19:58 devstack cinder-volume[93255]: we strongly recommend against using it for new projects. Jun 28 14:19:58 devstack cinder-volume[93255]: If you are already using Eventlet, we recommend migrating to a different Jun 28 14:19:58 devstack cinder-volume[93255]: framework. For more detail see Jun 28 14:19:58 devstack cinder-volume[93255]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 28 14:19:58 devstack cinder-volume[93255]: import eventlet # noqa Jun 28 14:19:59 devstack cinder-volume[92962]: DEBUG oslo_concurrency.lockutils [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Acquiring lock "singleton_lock" {{(pid=92962) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 28 14:19:59 devstack cinder-volume[92962]: DEBUG oslo_concurrency.lockutils [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Acquired lock "singleton_lock" {{(pid=92962) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 28 14:19:59 devstack cinder-volume[92962]: DEBUG oslo_concurrency.lockutils [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Releasing lock "singleton_lock" {{(pid=92962) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 28 14:19:59 devstack cinder-volume[92962]: WARNING amqp [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 28 14:19:59 devstack cinder-volume[92962]: WARNING amqp [None req-c7f9cb62-42a5-4702-8fee-b98b3f4de8f8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 28 14:20:01 devstack cinder-volume[93255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93255) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 28 14:20:01 devstack cinder-volume[93255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93255) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 28 14:20:01 devstack cinder-volume[93255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93255) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 28 14:20:01 devstack cinder-volume[93255]: INFO dbcounter [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] Registered counter for database cinder Jun 28 14:20:01 devstack cinder-volume[93255]: DEBUG oslo_db.sqlalchemy.engines [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93255) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG dbcounter [-] [93255] Writer thread running {{(pid=93255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 28 14:20:02 devstack cinder-volume[93255]: INFO cinder.rpc [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 28 14:20:02 devstack cinder-volume[93255]: INFO cinder.rpc [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_db.sqlalchemy.engines [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93255) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 28 14:20:02 devstack cinder-volume[93255]: INFO cinder.volume.manager [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] Determined volume DB was empty at startup. Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG cinder.volume.manager [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93255) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 28 14:20:02 devstack cinder-volume[93255]: WARNING stevedore.named [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 28 14:20:02 devstack cinder-volume[93255]: WARNING castellan.key_manager [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 28 14:20:02 devstack cinder-volume[93255]: WARNING cinder.keymgr.conf_key_mgr [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 28 14:20:02 devstack cinder-volume[93255]: INFO cinder.volume.manager [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_db.sqlalchemy.engines [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93255) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 28 14:20:02 devstack cinder-volume[93255]: INFO oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] Starting 1 workers Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] Started child 93561 {{(pid=93255) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 28 14:20:02 devstack cinder-volume[93561]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] Full set of CONF: {{(pid=93255) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] ******************************************************************************** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] Configuration options gathered from: {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] ================================================================================ {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] allow_availability_zone_fallback = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] allow_compression_on_image_upload = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] allowed_direct_url_schemes = [] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] api_rate_limit = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] auth_strategy = keystone {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_availability_zone = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_host = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_name = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_stats_polling_interval = 60 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backup_api_class = cinder.backup.api.API {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backup_name_template = backup-%s {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backup_use_same_host = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backup_use_temp_snapshot = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] chap_password = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] chap_username = {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cinder_internal_tenant_project_id = 4a0d92b847114b7c976618174510a9d0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cinder_internal_tenant_user_id = abc045664bea44bbb13e9b8c8b10774e {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cluster = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] compression_format = gzip {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] compute_api_class = cinder.compute.nova.API {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] config_dir = [] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] config_source = [] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] control_exchange = openstack {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] debug = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] default_availability_zone = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] default_group_type = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] default_volume_type = QuobyteHD {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] disk_geometry = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] driver_client_cert = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] driver_client_cert_key = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] driver_data_namespace = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] driver_ssl_cert_path = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] driver_ssl_cert_verify = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] driver_use_ssl = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] enable_new_services = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] enable_unsupported_driver = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] enabled_backends = ['QuobyteHD'] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] enforce_multipath_for_image_xfer = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] filter_function = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance_api_insecure = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance_api_servers = ['http://192.168.122.160/image'] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance_api_ssl_compression = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance_ca_certificates_file = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance_catalog_info = image:glance:publicURL {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance_certfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance_keyfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance_num_retries = 3 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance_request_timeout = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] goodness_function = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] graceful_shutdown_timeout = 5 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] group_api_class = cinder.group.api.API {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] host = devstack {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] image_compress_on_upload = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] image_conversion_address_space_limit = 1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] image_conversion_cpu_limit = 60 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] image_conversion_disable = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] image_upload_use_cinder_backend = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] image_upload_use_internal_tenant = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] image_volume_cache_enabled = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] image_volume_cache_max_count = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] image_volume_cache_max_size_gb = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] init_host_max_objects_retrieval = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] instance_format = [instance: %(uuid)s] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] iscsi_target_flags = {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] iscsi_write_cache = on {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] iser_helper = tgtadm {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] iser_ip_address = 192.168.122.160 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] iser_port = 3260 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] log_color = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] log_config_append = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] log_dir = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] log_file = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] log_options = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] log_rotate_interval = 1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] log_rotate_interval_type = days {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] log_rotation_type = none {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] max_age = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] max_logfile_count = 30 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] max_logfile_size_mb = 200 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] max_over_subscription_ratio = 20.0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] message_reap_interval = 86400 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] message_ttl = 2592000 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] migration_create_volume_timeout_secs = 300 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] monkey_patch = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] monkey_patch_modules = [] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] my_ip = 192.168.122.160 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] no_snapshot_gb_quota = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] num_iser_scan_tries = 3 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] num_shell_tries = 3 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] num_volume_device_scan_tries = 3 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] nvmeof_conn_info_version = 1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] nvmet_ns_id = 10 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] nvmet_port_id = 1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] osapi_max_limit = 1000 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] osapi_volume_ext_list = [] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] osapi_volume_listen_port = 8776 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] osapi_volume_use_ssl = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] osapi_volume_workers = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] per_volume_size_limit = -1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] periodic_fuzzy_delay = 60 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] periodic_interval = 60 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] public_endpoint = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] publish_errors = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] quota_backup_gigabytes = 1000 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] quota_backups = 10 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] quota_gigabytes = 1000 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] quota_groups = 10 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] quota_snapshots = 10 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] quota_volumes = 10 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] rate_limit_burst = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] rate_limit_except_level = CRITICAL {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] rate_limit_interval = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] reinit_driver_count = 3 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] replication_device = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] report_discard_supported = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] report_interval = 120 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] reservation_clean_interval = 86400 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] reservation_expire = 86400 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Starting volume driver QuobyteDriver (1.1.14) Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] reserved_image_namespaces = [] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93561) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] reserved_percentage = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] rpc_response_timeout = 120 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] run_external_periodic_tasks = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] scst_target_driver = iscsi {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] scst_target_iqn_name = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] service_down_time = 720 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] shell_completion = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] snapshot_name_template = snapshot-%s {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] split_loggers = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] state_path = /opt/stack/data/cinder {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] storage_availability_zone = nova {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] storage_protocol = iSCSI {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] syslog_log_facility = LOG_USER {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] target_helper = lioadm {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] target_ip_address = 192.168.122.160 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] target_port = 3260 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] target_protocol = iscsi {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] target_secondary_ip_addresses = [] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] trace_flags = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] transport_url = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] until_refresh = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] use_chap_auth = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] use_default_quota_class = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] use_journal = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] use_json = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] use_multipath_for_image_xfer = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] use_stderr = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] use_syslog = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] verify_glance_signatures = enabled {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] volume_api_class = cinder.volume.api.API {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] volume_backend_name = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] volume_clear = zero {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] volume_clear_ionice = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] volume_clear_size = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] volume_copy_bps_limit = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] volume_dd_blocksize = 1M {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] volume_name_template = volume-%s {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] volume_service_inithost_offload = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] volume_usage_audit_period = month {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] zoning_mode = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_concurrency.disable_process_locking = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.auth_section = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.auth_type = password {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.auth_version = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.cache = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.certfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.include_service_catalog = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.insecure = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.interface = public {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.keyfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_password = {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcache_username = {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.region_name = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.service_type = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.160/identity {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.backend = dogpile.cache.null {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.backend_argument = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.backend_expiration_time = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.config_prefix = cache.oslo {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.debug_cache_backend = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.enable_retry_client = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.enable_socket_keepalive = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.enabled = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.expiration_time = 600 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.hashclient_retry_attempts = 2 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.memcache_dead_retry = 300 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.memcache_pool_maxsize = 10 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.memcache_sasl_enabled = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.password = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.proxies = [] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.redis_db = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.redis_server = localhost:6379 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.retry_attempts = 2 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.retry_delay = 0.0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.socket_keepalive_count = 1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.socket_keepalive_idle = 1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.socket_keepalive_interval = 1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.socket_timeout = 1.0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.tls_allowed_ciphers = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.tls_cafile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.tls_certfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.tls_enabled = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.tls_keyfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cache.username = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] coordination.backend_url = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.asyncio_connection = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.asyncio_slave_connection = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.backend = sqlalchemy {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.connection = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.connection_debug = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.connection_parameters = {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.connection_recycle_time = 3600 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.connection_trace = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.db_inc_retry_interval = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.db_max_retries = 20 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.db_max_retry_interval = 10 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.db_retry_interval = 1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.max_overflow = 50 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.max_pool_size = 5 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.max_retries = 10 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.mysql_wsrep_sync_wait = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.pool_timeout = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.retry_interval = 10 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.slave_connection = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.sqlite_synchronous = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.synchronous_reader = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] database.use_db_reconnect = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] profiler.connection_string = messaging:// {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] profiler.enabled = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] profiler.es_doc_type = notification {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] profiler.es_scroll_size = 10000 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] profiler.es_scroll_time = 2m {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] profiler.filter_error_trace = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] profiler.hmac_keys = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] profiler.sentinel_service_name = mymaster {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] profiler.socket_timeout = 0.1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] profiler.trace_requests = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] profiler.trace_sqlalchemy = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] profiler_jaeger.process_tags = {} {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] profiler_jaeger.service_name_prefix = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] profiler_otlp.service_name_prefix = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_policy.enforce_new_defaults = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93561) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 28 14:20:02 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.quobyte [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 28 14:20:02 devstack cinder-volume[93255]: WARNING oslo_config.cfg [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_policy.enforce_scope = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.quobyte [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_policy.policy_default_rule = default {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_policy.policy_file = policy.yaml {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Running cmd (subprocess): mount.quobyte {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] privsep_osbrick.group = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] privsep_osbrick.helper_command = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] privsep_osbrick.user = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cinder_sys_admin.group = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cinder_sys_admin.helper_command = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] cinder_sys_admin.user = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] service_user.auth_section = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] service_user.auth_type = password {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] service_user.cafile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] service_user.certfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] service_user.collect_timing = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] service_user.insecure = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] service_user.keyfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] service_user.send_service_user_token = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] service_user.split_loggers = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] service_user.timeout = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance.auth_section = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance.auth_type = password {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance.certfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance.collect_timing = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance.insecure = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance.keyfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance.region_name = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance.split_loggers = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] glance.timeout = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.backend_availability_zone = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.chap_password = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.chap_username = {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.disk_geometry = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.driver_client_cert = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.driver_client_cert_key = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.driver_data_namespace = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.driver_use_ssl = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.extra_capabilities = {} {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.filter_function = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.goodness_function = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.iscsi_target_flags = {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.iscsi_write_cache = on {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.iser_helper = tgtadm {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.iser_ip_address = 192.168.122.160 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.iser_port = 3260 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.nas_host = {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.nas_login = admin {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.nas_mount_options = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.nas_password = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.nas_private_key = {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.nas_share_path = {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.num_shell_tries = 3 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.quobyte_volume_url = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.replication_device = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.report_discard_supported = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.reserved_percentage = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.target_helper = tgtadm {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.target_ip_address = 192.168.122.160 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.target_port = 3260 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.target_protocol = iscsi {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.trace_flags = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.unique_fqdn_network = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.use_chap_auth = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.volume_backend_name = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.volume_clear = zero {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.volume_clear_ionice = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.volume_clear_size = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_reports.file_event_handler = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_reports.log_dir = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.backend_availability_zone = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.backend_host = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.chap_password = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.chap_username = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.chiscsi_conf = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.disk_geometry = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.driver_client_cert = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.driver_data_namespace = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.driver_use_ssl = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.extra_capabilities = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.filter_function = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.goodness_function = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.iser_helper = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack quobyte-client[93562]: Reading configuration file: /etc/quobyte/client.cfg Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.iser_ip_address = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.iser_port = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.iser_target_prefix = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.nas_host = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack quobyte-client[93562]: Invalid parameters found, error: missing mount point. Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.nas_login = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.nas_mount_options = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.nas_password = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.nas_private_key = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack quobyte-client[93562]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 28 14:20:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:20:02 devstack quobyte-client[93562]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.nas_share_path = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:20:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.nas_ssh_port = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.num_shell_tries = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.nvmet_port_id = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.replication_device = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.report_discard_supported = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.reserved_percentage = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.scst_target_driver = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.storage_protocol = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.target_helper = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.target_ip_address = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.target_port = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.target_prefix = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.target_protocol = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.trace_flags = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.use_chap_auth = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.volume_clear = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.volume_clear_size = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] QuobyteHD.volumes_dir = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.ssl = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_notifications.driver = [] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_notifications.retry = -1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] key_manager.fixed_key = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.barbican_api_version = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.barbican_endpoint = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.barbican_endpoint_type = public {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.barbican_region_name = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.cafile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.certfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.collect_timing = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.insecure = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.keyfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.number_of_retries = 60 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.retry_delay = 1 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.send_service_user_token = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.split_loggers = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.timeout = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.verify_ssl = True {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican.verify_ssl_path = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican_service_user.auth_section = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican_service_user.auth_type = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican_service_user.cafile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican_service_user.certfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican_service_user.collect_timing = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican_service_user.insecure = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican_service_user.keyfile = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican_service_user.split_loggers = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] barbican_service_user.timeout = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] vault.approle_role_id = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] vault.approle_secret_id = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] vault.kv_mountpoint = secret {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] vault.kv_path = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] vault.kv_version = 2 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] vault.namespace = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] vault.root_token_id = **** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] vault.ssl_ca_crt_file = None {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] vault.timeout = 60.0 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] vault.use_ssl = False {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 28 14:20:02 devstack cinder-volume[93255]: DEBUG oslo_service.backend._eventlet.service [None req-705c032f-b0c0-41aa-9eed-2671b690ac96 None None] ******************************************************************************** {{(pid=93255) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 28 14:20:02 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:20:03 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Jun 28 14:20:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.656s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:20:03 devstack cinder-volume[93561]: INFO cinder.volume.driver [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Driver hasn't implemented _init_vendor_properties() Jun 28 14:20:03 devstack cinder-volume[93561]: DEBUG cinder.volume.driver [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7004318237305, 'free_capacity_gb': 1775.7004318237305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93561) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 28 14:20:03 devstack cinder-volume[93561]: DEBUG oslo_db.sqlalchemy.engines [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 28 14:20:03 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writer thread running {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 28 14:20:03 devstack cinder-volume[93561]: DEBUG cinder.db.api [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Building query based on filter {{(pid=93561) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 28 14:20:03 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93561) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 28 14:20:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:20:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:20:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:20:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:20:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:20:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:20:03 devstack cinder-volume[93561]: INFO cinder.keymgr.migration [None req-01def30e-7be8-4682-9b59-3a22962950c2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 28 14:20:03 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:20:03 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:20:04 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jun 28 14:20:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.645s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:20:04 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:20:04 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Driver initialization completed successfully. Jun 28 14:20:04 devstack cinder-volume[93561]: INFO cinder.manager [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Initiating service 3 cleanup Jun 28 14:20:04 devstack cinder-volume[93561]: INFO cinder.manager [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Service 3 cleanup completed. Jun 28 14:20:04 devstack cinder-volume[93561]: DEBUG cinder.service [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Creating RPC server for service cinder-volume {{(pid=93561) start /opt/stack/cinder/cinder/service.py:231}} Jun 28 14:20:04 devstack cinder-volume[93561]: DEBUG cinder.service [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93561) start /opt/stack/cinder/cinder/service.py:237}} Jun 28 14:20:04 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 28 14:20:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:20:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:20:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:20:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:20:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:20:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:20:04 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:20:04 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:20:04 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Jun 28 14:20:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.625s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:20:04 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-9b90f559-bbaa-4274-a520-f10042b8ce7c None None] Driver post RPC initialization completed successfully. Jun 28 14:20:12 devstack cinder-volume[93255]: DEBUG dbcounter [-] [93255] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:20:14 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=4 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:20:14 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:20:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:20:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 6 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:20:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:21:21 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:21:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Flow 'volume_create_manager' (f4218639-de4a-4c46-83b3-32494ce19e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:21:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7508267a-eb16-4e0c-80f5-a6903c5e2b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7508267a-eb16-4e0c-80f5-a6903c5e2b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1783634013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ff6b37-3023-4449-8073-e9d4cef277d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a94469e7984bfd9509e6697ae56493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:21:22Z,use_quota=True,user_id='eaef65c66a194755b9542f9bbdcc8eef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46df6cc-5445-43e2-868e-be2e24ce31cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46df6cc-5445-43e2-868e-be2e24ce31cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a41dd0-069c-4a6a-a654-044267dd3b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a41dd0-069c-4a6a-a654-044267dd3b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98ff6b37-3023-4449-8073-e9d4cef277d7', 'volume_name': 'volume-98ff6b37-3023-4449-8073-e9d4cef277d7', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60aee3fb-db57-4d18-90a8-b710cd6ca96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60aee3fb-db57-4d18-90a8-b710cd6ca96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323b659f-1456-4de9-bcb1-28dc75237dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:21:22 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Volume 98ff6b37-3023-4449-8073-e9d4cef277d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98ff6b37-3023-4449-8073-e9d4cef277d7', 'volume_size': 1} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1783634013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ff6b37-3023-4449-8073-e9d4cef277d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a94469e7984bfd9509e6697ae56493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:21:22Z,use_quota=True,user_id='eaef65c66a194755b9542f9bbdcc8eef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Creating volume 98ff6b37-3023-4449-8073-e9d4cef277d7 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:21:22 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:21:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98ff6b37-3023-4449-8073-e9d4cef277d7 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:21:22 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98ff6b37-3023-4449-8073-e9d4cef277d7 1073741824 Jun 28 14:21:22 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:21:23 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Jun 28 14:21:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98ff6b37-3023-4449-8073-e9d4cef277d7 1073741824" returned: 0 in 1.278s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:21:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98ff6b37-3023-4449-8073-e9d4cef277d7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:21:23 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98ff6b37-3023-4449-8073-e9d4cef277d7 Jun 28 14:21:23 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:21:24 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Jun 28 14:21:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98ff6b37-3023-4449-8073-e9d4cef277d7" returned: 0 in 1.074s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:21:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] <== create_volume: return (2456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:21:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.464s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:21:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323b659f-1456-4de9-bcb1-28dc75237dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98ff6b37-3023-4449-8073-e9d4cef277d7', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:21:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ed5dd8-e9b6-4a71-b51b-ac306a3b8c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:21:24 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Volume volume-98ff6b37-3023-4449-8073-e9d4cef277d7 (98ff6b37-3023-4449-8073-e9d4cef277d7): created successfully Jun 28 14:21:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ed5dd8-e9b6-4a71-b51b-ac306a3b8c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:21:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Flow 'volume_create_manager' (f4218639-de4a-4c46-83b3-32494ce19e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:21:24 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-5ed15955-dbb1-4878-8157-0afbff1daa92 tempest-DeleteServersTestJSON-1178112612 None] Created volume successfully. Jun 28 14:21:32 devstack cinder-volume[93561]: WARNING py.warnings [req-bab1336b-252c-4413-973b-7892c6453f3f req-8eab3b0a-f12a-4985-a425-40ba803367af tempest-DeleteServersTestJSON-1178112612 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 28 14:21:32 devstack cinder-volume[93561]: .first() Jun 28 14:21:32 devstack cinder-volume[93561]: Jun 28 14:21:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-bab1336b-252c-4413-973b-7892c6453f3f req-8eab3b0a-f12a-4985-a425-40ba803367af tempest-DeleteServersTestJSON-1178112612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:21:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-bab1336b-252c-4413-973b-7892c6453f3f req-8eab3b0a-f12a-4985-a425-40ba803367af tempest-DeleteServersTestJSON-1178112612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:21:32 devstack cinder-volume[93561]: INFO oslo.privsep.daemon [req-bab1336b-252c-4413-973b-7892c6453f3f req-8eab3b0a-f12a-4985-a425-40ba803367af tempest-DeleteServersTestJSON-1178112612 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6_xsv_93/privsep.sock'] Jun 28 14:21:32 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6_xsv_93/privsep.sock Jun 28 14:21:32 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:21:33 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:21:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Flow 'volume_create_manager' (30cf0b3a-8df2-4ae1-9d27-281d9031a4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:21:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277f0c26-fb65-41da-9549-2e8e1ec72228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:21:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277f0c26-fb65-41da-9549-2e8e1ec72228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1954807284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50ff134-f4a9-4751-b260-f6cea0285532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ecb8b20959b4251bb747e5974bf618c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:21:33Z,use_quota=True,user_id='4784ba3911f24c5d9f10d0a7944470c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:21:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa33e46-8ff8-472f-8add-59a6bcd51568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:21:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa33e46-8ff8-472f-8add-59a6bcd51568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:21:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2a85d2-c34d-4ce5-8ed8-d67aa8c2e8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:21:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2a85d2-c34d-4ce5-8ed8-d67aa8c2e8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50ff134-f4a9-4751-b260-f6cea0285532', 'volume_name': 'volume-d50ff134-f4a9-4751-b260-f6cea0285532', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:21:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a129606e-3bff-4c59-9529-9ea3ec39757e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:21:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a129606e-3bff-4c59-9529-9ea3ec39757e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:21:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cbae16-f7dd-4759-94f7-506a655a71e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:21:33 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Volume d50ff134-f4a9-4751-b260-f6cea0285532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50ff134-f4a9-4751-b260-f6cea0285532', 'volume_size': 1} Jun 28 14:21:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:21:33 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 28 14:21:33 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 28 14:21:33 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 28 14:21:33 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: Jun 28 14:21:33 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 28 14:21:33 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 28 14:21:33 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 28 14:21:33 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: Jun 28 14:21:33 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 28 14:21:34 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 28 14:21:34 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 28 14:21:34 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 28 14:21:34 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: Jun 28 14:21:34 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 28 14:21:34 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 28 14:21:34 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 28 14:21:34 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: Jun 28 14:21:34 devstack cinder-volume[93561]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 28 14:21:35 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Jun 28 14:21:35 devstack cinder-volume[93561]: INFO oslo.privsep.daemon [req-bab1336b-252c-4413-973b-7892c6453f3f req-8eab3b0a-f12a-4985-a425-40ba803367af tempest-DeleteServersTestJSON-1178112612 None] Spawned new privsep daemon via rootwrap Jun 28 14:21:35 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [req-bab1336b-252c-4413-973b-7892c6453f3f req-8eab3b0a-f12a-4985-a425-40ba803367af tempest-DeleteServersTestJSON-1178112612 None] Accepted privsep connection to /tmp/tmp6_xsv_93/privsep.sock {{(pid=93561) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 28 14:21:35 devstack cinder-volume[93561]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 28 14:21:35 devstack cinder-volume[93561]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 28 14:21:35 devstack cinder-volume[93561]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 28 14:21:35 devstack cinder-volume[93561]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94796 Jun 28 14:21:35 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c480995-7a86-4eb8-b5b8-066e397de906]: (2,) {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:21:35 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19c7a98-4777-4ef6-8066-57262d3562b5]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:21:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-bab1336b-252c-4413-973b-7892c6453f3f req-8eab3b0a-f12a-4985-a425-40ba803367af tempest-DeleteServersTestJSON-1178112612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98ff6b37-3023-4449-8073-e9d4cef277d7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:21:35 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98ff6b37-3023-4449-8073-e9d4cef277d7 Jun 28 14:21:35 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:21:36 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Jun 28 14:21:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-bab1336b-252c-4413-973b-7892c6453f3f req-8eab3b0a-f12a-4985-a425-40ba803367af tempest-DeleteServersTestJSON-1178112612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98ff6b37-3023-4449-8073-e9d4cef277d7" returned: 0 in 1.134s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:21:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-bab1336b-252c-4413-973b-7892c6453f3f req-8eab3b0a-f12a-4985-a425-40ba803367af tempest-DeleteServersTestJSON-1178112612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.882s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:21:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.246s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:21:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1954807284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50ff134-f4a9-4751-b260-f6cea0285532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ecb8b20959b4251bb747e5974bf618c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:21:33Z,use_quota=True,user_id='4784ba3911f24c5d9f10d0a7944470c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:21:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Creating volume d50ff134-f4a9-4751-b260-f6cea0285532 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:21:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:21:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:21:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:21:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:21:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:21:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:21:36 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:21:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d50ff134-f4a9-4751-b260-f6cea0285532 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:21:36 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d50ff134-f4a9-4751-b260-f6cea0285532 1073741824 Jun 28 14:21:36 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:21:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-bab1336b-252c-4413-973b-7892c6453f3f req-8eab3b0a-f12a-4985-a425-40ba803367af tempest-DeleteServersTestJSON-1178112612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-98ff6b37-3023-4449-8073-e9d4cef277d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9879b42e-a289-476b-8af4-0af0c471d084', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:21:37 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-bab1336b-252c-4413-973b-7892c6453f3f req-8eab3b0a-f12a-4985-a425-40ba803367af tempest-DeleteServersTestJSON-1178112612 None] attachment_update completed successfully. Jun 28 14:21:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:21:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:21:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:21:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:21:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:21:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:21:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:21:37 devstack sudo[94812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:21:37 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:21:38 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Jun 28 14:21:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d50ff134-f4a9-4751-b260-f6cea0285532 1073741824" returned: 0 in 1.673s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:21:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d50ff134-f4a9-4751-b260-f6cea0285532 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:21:38 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d50ff134-f4a9-4751-b260-f6cea0285532 Jun 28 14:21:38 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:21:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.181s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:21:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:21:39 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:21:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 8 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:21:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:21:38 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root Jun 28 14:21:40 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Jun 28 14:21:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d50ff134-f4a9-4751-b260-f6cea0285532" returned: 0 in 2.021s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:21:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] <== create_volume: return (3830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:21:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.849s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:21:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cbae16-f7dd-4759-94f7-506a655a71e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50ff134-f4a9-4751-b260-f6cea0285532', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:21:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bac5118-7a23-40a0-b501-dc153be4bbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:21:40 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Volume volume-d50ff134-f4a9-4751-b260-f6cea0285532 (d50ff134-f4a9-4751-b260-f6cea0285532): created successfully Jun 28 14:21:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bac5118-7a23-40a0-b501-dc153be4bbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:21:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Flow 'volume_create_manager' (30cf0b3a-8df2-4ae1-9d27-281d9031a4a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:21:40 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-6e3fcb3d-cb61-4760-a351-5fba616c17e0 tempest-VolumesAdminNegativeTest-1942765048 None] Created volume successfully. Jun 28 14:21:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Acquiring lock "cinder-d50ff134-f4a9-4751-b260-f6cea0285532-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:21:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Lock "cinder-d50ff134-f4a9-4751-b260-f6cea0285532-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:21:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Acquiring lock "cinder-quobyte-d50ff134-f4a9-4751-b260-f6cea0285532" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:21:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Lock "cinder-quobyte-d50ff134-f4a9-4751-b260-f6cea0285532" acquired by "delete_volume" :: waited 0.039s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:21:42 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfd695d-a66d-4a82-b2a3-eabfb4a11995]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:21:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d50ff134-f4a9-4751-b260-f6cea0285532 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:21:43 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d50ff134-f4a9-4751-b260-f6cea0285532 Jun 28 14:21:43 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:21:44 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Jun 28 14:21:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d50ff134-f4a9-4751-b260-f6cea0285532" returned: 0 in 1.514s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:21:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d50ff134-f4a9-4751-b260-f6cea0285532 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:21:44 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d50ff134-f4a9-4751-b260-f6cea0285532 Jun 28 14:21:44 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:21:45 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Jun 28 14:21:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d50ff134-f4a9-4751-b260-f6cea0285532" returned: 0 in 1.013s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:21:45 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Lock "cinder-quobyte-d50ff134-f4a9-4751-b260-f6cea0285532" released by "delete_volume" :: held 2.590s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:21:45 devstack cinder-volume[93561]: WARNING cinder.quota [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:21:45 devstack cinder-volume[93561]: WARNING cinder.quota [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:21:45 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Created reservations ['a2d1e2e4-e160-4775-8907-e3cddffba4c9', 'ef1bbba1-1c8f-461b-987a-4a2b3f5c72c4', '36f0fe77-f30c-4b34-bb2f-597bb95baa44', '15820b9e-3f78-4ffd-9e6f-d53b1f08bc07'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:21:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:21:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:21:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:21:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:21:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:21:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:21:45 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:21:45 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:21:47 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Jun 28 14:21:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.143s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:21:47 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:21:47 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Deleted volume successfully. Jun 28 14:21:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cbe7e9db-5351-4bfb-b043-5dbeb9959f9b tempest-VolumesAdminNegativeTest-1942765048 None] Lock "cinder-d50ff134-f4a9-4751-b260-f6cea0285532-delete_volume" released by "delete_volume" :: held 4.496s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:21:49 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-c8e39fa3-ff51-4e7a-aa6a-2f4646c4d0ff req-95f2c195-c794-459d-bd03-3af370c74f91 tempest-DeleteServersTestJSON-1178112612 None] Terminate volume connection completed successfully. Jun 28 14:21:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-c8e39fa3-ff51-4e7a-aa6a-2f4646c4d0ff req-95f2c195-c794-459d-bd03-3af370c74f91 tempest-DeleteServersTestJSON-1178112612 None] Deleting attachment 9879b42e-a289-476b-8af4-0af0c471d084. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:21:53 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Acquiring lock "cinder-98ff6b37-3023-4449-8073-e9d4cef277d7-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:21:53 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Lock "cinder-98ff6b37-3023-4449-8073-e9d4cef277d7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:21:53 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Acquiring lock "cinder-quobyte-98ff6b37-3023-4449-8073-e9d4cef277d7" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:21:53 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Lock "cinder-quobyte-98ff6b37-3023-4449-8073-e9d4cef277d7" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:21:53 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6ccb63-9e40-4fbc-9e9c-5f2a7f53b411]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:21:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98ff6b37-3023-4449-8073-e9d4cef277d7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:21:53 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98ff6b37-3023-4449-8073-e9d4cef277d7 Jun 28 14:21:53 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:21:54 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Jun 28 14:21:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98ff6b37-3023-4449-8073-e9d4cef277d7" returned: 0 in 0.803s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:21:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98ff6b37-3023-4449-8073-e9d4cef277d7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:21:54 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98ff6b37-3023-4449-8073-e9d4cef277d7 Jun 28 14:21:54 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:21:55 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Jun 28 14:21:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98ff6b37-3023-4449-8073-e9d4cef277d7" returned: 0 in 0.707s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:21:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Lock "cinder-quobyte-98ff6b37-3023-4449-8073-e9d4cef277d7" released by "delete_volume" :: held 1.556s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:21:55 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Created reservations ['dd9fcbb8-8fc4-4a18-8b2a-ce94a853d592', 'bc1c0a1e-1f4c-4ea6-ac85-6a332b4d1303', '589ac130-4905-4374-a2de-b90b53ca0174', '92380bd4-7de1-43a1-b39a-3195713e0877'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:21:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:21:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:21:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:21:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:21:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:21:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:21:55 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:21:55 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:21:56 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jun 28 14:21:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.750s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:21:56 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:21:56 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Deleted volume successfully. Jun 28 14:21:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f740c16-b802-4b73-a784-d358faf1654b tempest-DeleteServersTestJSON-1178112612 None] Lock "cinder-98ff6b37-3023-4449-8073-e9d4cef277d7-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:UPDATE=25,cinder:SELECT=22,cinder:INSERT=2,cinder:DELETE=2 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Flow 'volume_create_manager' (789a72c8-94c6-4c15-82b1-203594a7704b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d4619b-014f-40cb-9053-19bab27feddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d4619b-014f-40cb-9053-19bab27feddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-195898656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21eba21d-7964-497e-8968-a0dbcc0b2d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312033ff9375429b8bf8b6629fb446e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:22:06Z,use_quota=True,user_id='d48c350a8b3a4f1b8ed3f75320ecb8d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea396ab6-34e5-48aa-a8c5-5507b8f26e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea396ab6-34e5-48aa-a8c5-5507b8f26e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a6b9d4-51ac-4172-a46b-3fb0190e9eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a6b9d4-51ac-4172-a46b-3fb0190e9eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21eba21d-7964-497e-8968-a0dbcc0b2d77', 'volume_name': 'volume-21eba21d-7964-497e-8968-a0dbcc0b2d77', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2eca22-06d5-402c-8d4d-12ad19850d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2eca22-06d5-402c-8d4d-12ad19850d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea01a1c-e450-4edc-895a-4b9457e405c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:06 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Volume 21eba21d-7964-497e-8968-a0dbcc0b2d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21eba21d-7964-497e-8968-a0dbcc0b2d77', 'volume_size': 1} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-195898656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21eba21d-7964-497e-8968-a0dbcc0b2d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312033ff9375429b8bf8b6629fb446e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:22:06Z,use_quota=True,user_id='d48c350a8b3a4f1b8ed3f75320ecb8d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Creating volume 21eba21d-7964-497e-8968-a0dbcc0b2d77 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:22:06 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:22:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:22:06 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77 1073741824 Jun 28 14:22:06 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:22:07 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Jun 28 14:22:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77 1073741824" returned: 0 in 1.041s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:22:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:22:07 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77 Jun 28 14:22:07 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:22:07 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:22:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Flow 'volume_create_manager' (c9a8ce5b-38ff-4a8f-88ae-1c0c6bef39c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:22:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5e54ac-a14a-4d11-9837-aaff02cb1e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5e54ac-a14a-4d11-9837-aaff02cb1e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-399849107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49107d7-a416-43d5-8dbf-b620f11baffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b6c330f03d4ce782d807aac6181f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:22:08Z,use_quota=True,user_id='7d1b60c3e9f741348118075f3dda9f4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8c1726-9900-4348-bf03-60827608dc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8c1726-9900-4348-bf03-60827608dc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c085b1a3-1e6d-463c-9913-01c8a6b77860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c085b1a3-1e6d-463c-9913-01c8a6b77860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e49107d7-a416-43d5-8dbf-b620f11baffa', 'volume_name': 'volume-e49107d7-a416-43d5-8dbf-b620f11baffa', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244c5b74-1212-420a-b589-9279f0c4f19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244c5b74-1212-420a-b589-9279f0c4f19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7c831a-75c8-47b4-8ce0-3072e59811ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:07 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Volume e49107d7-a416-43d5-8dbf-b620f11baffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e49107d7-a416-43d5-8dbf-b620f11baffa', 'volume_size': 1} Jun 28 14:22:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:22:08 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77" returned: 0 in 1.001s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-399849107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49107d7-a416-43d5-8dbf-b620f11baffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b6c330f03d4ce782d807aac6181f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:22:08Z,use_quota=True,user_id='7d1b60c3e9f741348118075f3dda9f4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Creating volume e49107d7-a416-43d5-8dbf-b620f11baffa {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:22:08 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e49107d7-a416-43d5-8dbf-b620f11baffa 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea01a1c-e450-4edc-895a-4b9457e405c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21eba21d-7964-497e-8968-a0dbcc0b2d77', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c77977c-2f55-4cae-aa75-c034083d6231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:08 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e49107d7-a416-43d5-8dbf-b620f11baffa 1073741824 Jun 28 14:22:08 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:22:08 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Volume volume-21eba21d-7964-497e-8968-a0dbcc0b2d77 (21eba21d-7964-497e-8968-a0dbcc0b2d77): created successfully Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c77977c-2f55-4cae-aa75-c034083d6231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Flow 'volume_create_manager' (789a72c8-94c6-4c15-82b1-203594a7704b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:22:08 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-8668da9b-24e2-4240-991c-f17d82f37af0 tempest-ServerActionsTestOtherA-1135190114 None] Created volume successfully. Jun 28 14:22:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e49107d7-a416-43d5-8dbf-b620f11baffa 1073741824" returned: 0 in 1.154s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:22:09 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Jun 28 14:22:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e49107d7-a416-43d5-8dbf-b620f11baffa {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:22:09 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e49107d7-a416-43d5-8dbf-b620f11baffa Jun 28 14:22:09 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:22:10 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Jun 28 14:22:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e49107d7-a416-43d5-8dbf-b620f11baffa" returned: 0 in 0.763s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:22:10 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:22:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:22:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7c831a-75c8-47b4-8ce0-3072e59811ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e49107d7-a416-43d5-8dbf-b620f11baffa', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0dc667-8744-4f25-bd06-0f26e38be5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:10 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Volume volume-e49107d7-a416-43d5-8dbf-b620f11baffa (e49107d7-a416-43d5-8dbf-b620f11baffa): created successfully Jun 28 14:22:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0dc667-8744-4f25-bd06-0f26e38be5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Flow 'volume_create_manager' (c9a8ce5b-38ff-4a8f-88ae-1c0c6bef39c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:22:10 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-3ec4b1b9-3ab0-4e3f-ba1b-2c7225044ad9 tempest-TaggedAttachmentsTest-1980492223 None] Created volume successfully. Jun 28 14:22:20 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=25,cinder:INSERT=10,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:22:20 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:UPDATE=6,cinder:SELECT=3,cinder:DELETE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:22:22 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:22:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Flow 'volume_create_manager' (b95eee8a-d147-42a1-aa78-1ef450a7970b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:22:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878cfd03-c4cb-46d9-9529-d6233a20b340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878cfd03-c4cb-46d9-9529-d6233a20b340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-710856094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b03d8b-fdf2-45d1-a466-fc517ace71b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ded726a2ed6a49ddad38f90e8b59127b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:22:23Z,use_quota=True,user_id='7b3e03b86db14bc2a1a637ea8c159e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1095c018-06ca-4d8f-95f2-0460847a6dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1095c018-06ca-4d8f-95f2-0460847a6dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7513933-3091-41a0-9751-cdd072015741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7513933-3091-41a0-9751-cdd072015741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56b03d8b-fdf2-45d1-a466-fc517ace71b5', 'volume_name': 'volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318c24ad-50e7-4a76-b8c5-bfffe5e23dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318c24ad-50e7-4a76-b8c5-bfffe5e23dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a371cd4-f26b-4913-b8e4-82a541ec59f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:23 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Volume 56b03d8b-fdf2-45d1-a466-fc517ace71b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5', 'volume_size': 1} Jun 28 14:22:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:22:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:22:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-710856094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b03d8b-fdf2-45d1-a466-fc517ace71b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ded726a2ed6a49ddad38f90e8b59127b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:22:23Z,use_quota=True,user_id='7b3e03b86db14bc2a1a637ea8c159e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:22:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Creating volume 56b03d8b-fdf2-45d1-a466-fc517ace71b5 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:22:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:22:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:22:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:22:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:22:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:22:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:22:23 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:22:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:22:23 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5 1073741824 Jun 28 14:22:23 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:22:23 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jun 28 14:22:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5 1073741824" returned: 0 in 0.865s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:22:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:22:23 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5 Jun 28 14:22:23 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:22:24 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jun 28 14:22:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5" returned: 0 in 0.735s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:22:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:22:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:22:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a371cd4-f26b-4913-b8e4-82a541ec59f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067ae1d0-10f5-4e4e-8ff5-eaa0c6ef0d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:24 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Volume volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5 (56b03d8b-fdf2-45d1-a466-fc517ace71b5): created successfully Jun 28 14:22:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067ae1d0-10f5-4e4e-8ff5-eaa0c6ef0d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Flow 'volume_create_manager' (b95eee8a-d147-42a1-aa78-1ef450a7970b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:22:24 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-223c244f-98fd-4ae8-8f21-d8ad78234438 req-04c277ea-6844-4cd8-9706-5d51090eac2c tempest-VolumesGetTestJSON-674786359 None] Created volume successfully. Jun 28 14:22:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Acquiring lock "cinder-56b03d8b-fdf2-45d1-a466-fc517ace71b5-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:22:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Lock "cinder-56b03d8b-fdf2-45d1-a466-fc517ace71b5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:22:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Acquiring lock "cinder-quobyte-56b03d8b-fdf2-45d1-a466-fc517ace71b5" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:22:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Lock "cinder-quobyte-56b03d8b-fdf2-45d1-a466-fc517ace71b5" acquired by "delete_volume" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:22:25 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37f1d08-3e37-4d1c-96e0-040a2e93e520]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:22:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:22:25 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5 Jun 28 14:22:25 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:22:26 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Jun 28 14:22:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5" returned: 0 in 0.872s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:22:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:22:26 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5 Jun 28 14:22:26 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:22:27 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jun 28 14:22:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-56b03d8b-fdf2-45d1-a466-fc517ace71b5" returned: 0 in 0.729s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:22:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Lock "cinder-quobyte-56b03d8b-fdf2-45d1-a466-fc517ace71b5" released by "delete_volume" :: held 1.650s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:22:27 devstack cinder-volume[93561]: DEBUG cinder.quota [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Created reservations ['5f52646b-76f1-4dcb-b174-02ac854b26e6', '5ed3d588-d72d-4799-b86a-4bed39010bdc', '9abc63c6-672e-4217-a0e3-11a564304960', '5040a71c-ccb4-4857-ab74-c0458aaf371a'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:22:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:22:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:22:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:22:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:22:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:22:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:22:27 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:22:27 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:22:28 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Jun 28 14:22:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.839s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:22:28 devstack cinder-volume[93561]: DEBUG cinder.manager [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:22:28 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Deleted volume successfully. Jun 28 14:22:28 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-16b864de-764a-4233-b3a5-421cecb61799 req-e017f274-6b51-4da5-a38d-eec880fa7670 tempest-VolumesGetTestJSON-674786359 None] Lock "cinder-56b03d8b-fdf2-45d1-a466-fc517ace71b5-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:22:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-37592de5-4d61-4ef3-b9a4-5e0866897921 tempest-BackendsCapabilitiesAdminTestsJSON-1349420853 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7004318237305, 'free_capacity_gb': 1775.7004318237305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93561) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 28 14:22:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-40fdca79-16c1-45f3-b56c-59bd878e1063 tempest-BackendsCapabilitiesAdminTestsJSON-1349420853 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7004318237305, 'free_capacity_gb': 1775.7004318237305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93561) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 28 14:22:37 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:UPDATE=15,cinder:SELECT=8,cinder:DELETE=1,cinder:INSERT=2 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:22:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:22:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:22:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:22:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:22:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:22:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:22:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:22:37 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:22:37 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:22:38 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:22:39 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Jun 28 14:22:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.787s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:22:39 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:22:39 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:22:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 8 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:22:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:22:56 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-efcadf78-d2d3-4fcd-8099-132ac7b5214e tempest-GroupsV314Test-734898949 None] Group tempest-GroupsV314Test-Group-1310551456: creating Jun 28 14:22:56 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-efcadf78-d2d3-4fcd-8099-132ac7b5214e tempest-GroupsV314Test-734898949 None] Group tempest-GroupsV314Test-Group-1310551456: created successfully Jun 28 14:22:56 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-efcadf78-d2d3-4fcd-8099-132ac7b5214e tempest-GroupsV314Test-734898949 None] Create group completed successfully. Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Flow 'volume_create_manager' (702a1879-14f1-45f4-8930-c1e474b88567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097ebb1b-c11e-40c7-9564-6738a5139184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097ebb1b-c11e-40c7-9564-6738a5139184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-678802381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c7ebc63-319b-4231-83b2-156398dfb949,host='devstack@QuobyteHD#QuobyteHD',id=e7009aec-5bf1-42e7-b144-7170ab2d18fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdad2a4a9052458e98125072ff4cdd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:22:58Z,use_quota=True,user_id='419b3eea0d1c4d83bacba0780cdcb740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fba067-0081-435c-966a-0a0fdb9286df),volume_type_id=08fba067-0081-435c-966a-0a0fdb9286df)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b35d61c-923a-402d-8af6-47b6db5473ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b35d61c-923a-402d-8af6-47b6db5473ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94829729-29f9-4fbd-a772-c1bea8268102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94829729-29f9-4fbd-a772-c1bea8268102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7009aec-5bf1-42e7-b144-7170ab2d18fc', 'volume_name': 'volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d326d4-4764-4507-a68b-9f0a2f19c874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d326d4-4764-4507-a68b-9f0a2f19c874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c18bcd-2cdf-4b9b-9447-2207df608643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:58 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Volume e7009aec-5bf1-42e7-b144-7170ab2d18fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc', 'volume_size': 1} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6c7ebc63-319b-4231-83b2-156398dfb949,created_at=2026-06-28T12:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-678802381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c7ebc63-319b-4231-83b2-156398dfb949,host='devstack@QuobyteHD#QuobyteHD',id=e7009aec-5bf1-42e7-b144-7170ab2d18fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdad2a4a9052458e98125072ff4cdd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:22:58Z,use_quota=True,user_id='419b3eea0d1c4d83bacba0780cdcb740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fba067-0081-435c-966a-0a0fdb9286df),volume_type_id=08fba067-0081-435c-966a-0a0fdb9286df)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Creating volume e7009aec-5bf1-42e7-b144-7170ab2d18fc {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:22:58 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:22:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:22:58 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc 1073741824 Jun 28 14:22:58 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:22:59 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Jun 28 14:22:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc 1073741824" returned: 0 in 0.972s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:22:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:22:59 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc Jun 28 14:22:59 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:22:59 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Jun 28 14:22:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc" returned: 0 in 0.658s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:22:59 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:22:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:22:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c18bcd-2cdf-4b9b-9447-2207df608643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e49b7f0-25c4-4baa-add8-50ef53f6127b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:22:59 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Volume volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc (e7009aec-5bf1-42e7-b144-7170ab2d18fc): created successfully Jun 28 14:22:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e49b7f0-25c4-4baa-add8-50ef53f6127b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:22:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Flow 'volume_create_manager' (702a1879-14f1-45f4-8930-c1e474b88567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:22:59 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-1af26430-b5ea-4ca9-a382-70b79b971f8b tempest-GroupsV314Test-734898949 None] Created volume successfully. Jun 28 14:23:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:02 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Cloning volume e7009aec-5bf1-42e7-b144-7170ab2d18fc to volume 6d1528f4-747d-4851-8670-d7b8ca45becf Jun 28 14:23:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Creating offline snapshot cdff9115-f96f-41fe-aa49-dd0a5346fe59 of volume e7009aec-5bf1-42e7-b144-7170ab2d18fc {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:23:02 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dfabe6-1cce-476e-800b-f4ae95fdc919]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:02 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc Jun 28 14:23:02 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:03 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc" returned: 0 in 1.037s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:03 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 1G Jun 28 14:23:03 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:04 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 1G" returned: 0 in 1.047s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:04 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 Jun 28 14:23:04 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:05 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59" returned: 0 in 0.775s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:05 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 is being set with open permissions: ugo+rw: NotImplementedError Jun 28 14:23:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:05 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 Jun 28 14:23:05 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:05 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59" returned: 0 in 0.806s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:06 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.info Jun 28 14:23:06 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-e5bc4aa5-8acc-4dad-bbec-4db98a02716b req-001b4a80-e3fc-4356-9a45-945b7bf10186 tempest-ServerActionsTestOtherA-1135190114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:06 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.info" returned: 0 in 0.777s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:06 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.info is being set with open permissions: ugo+rw: NotImplementedError Jun 28 14:23:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:06 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.info Jun 28 14:23:06 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:07 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.info" returned: 0 in 0.747s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:07 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Acquiring lock "cinder-quobyte-6d1528f4-747d-4851-8670-d7b8ca45becf" by "_copy_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:23:07 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Lock "cinder-quobyte-6d1528f4-747d-4851-8670-d7b8ca45becf" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:23:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] snapshot: cdff9115-f96f-41fe-aa49-dd0a5346fe59, volume: 6d1528f4-747d-4851-8670-d7b8ca45becf, {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 28 14:23:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:23:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:23:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:07 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d50d27-b02e-482c-8b31-1a3365d983c2]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:07 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 Jun 28 14:23:07 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:08 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59" returned: 0 in 1.108s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:23:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 28 14:23:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Creating direct copy from snapshot {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 28 14:23:08 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[29da1b50-535e-4148-8649-74063768cd1b]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:08 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc Jun 28 14:23:08 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:09 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc" returned: 0 in 1.096s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:09 devstack cinder-volume[93561]: DEBUG cinder.utils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Path /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d1528f4-747d-4851-8670-d7b8ca45becf not found in is_blk_device check {{(pid=93561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 28 14:23:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d1528f4-747d-4851-8670-d7b8ca45becf {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:09 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d1528f4-747d-4851-8670-d7b8ca45becf Jun 28 14:23:09 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:16 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d1528f4-747d-4851-8670-d7b8ca45becf" returned: 0 in 6.391s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:16 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a59945-fb93-4831-b581-56aded0bb801]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:16 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc Jun 28 14:23:16 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:16 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=11,cinder:UPDATE=6 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:23:16 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:23:17 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc" returned: 0 in 0.954s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Image conversion details: src /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d1528f4-747d-4851-8670-d7b8ca45becf {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:23:17 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Converted 1024.00 MB image at 160.19 MB/s Jun 28 14:23:17 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d1528f4-747d-4851-8670-d7b8ca45becf is being set with open permissions: ugo+rw: NotImplementedError Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d1528f4-747d-4851-8670-d7b8ca45becf {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:17 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d1528f4-747d-4851-8670-d7b8ca45becf Jun 28 14:23:17 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Flow 'volume_create_manager' (a617e574-4f76-4041-931f-63208d654fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50058cf2-6f30-44aa-9d52-a743c9ce73f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50058cf2-6f30-44aa-9d52-a743c9ce73f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-129856794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e0d826-4351-423e-8493-8d2d98ebf86b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5226392366384f0cb511bd8be620b1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:23:17Z,use_quota=True,user_id='b5eb7564f34d4cfe8d850150213023d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1365992a-e129-42e4-a5c7-59998d4ce030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1365992a-e129-42e4-a5c7-59998d4ce030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8278e00b-4672-4c08-bdb7-24e4e52e02a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8278e00b-4672-4c08-bdb7-24e4e52e02a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7e0d826-4351-423e-8493-8d2d98ebf86b', 'volume_name': 'volume-c7e0d826-4351-423e-8493-8d2d98ebf86b', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba50955-e52e-4182-814f-8eff17f1da84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba50955-e52e-4182-814f-8eff17f1da84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1b7fd4-641b-4f66-bb2e-dc197df28cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:17 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Volume c7e0d826-4351-423e-8493-8d2d98ebf86b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7e0d826-4351-423e-8493-8d2d98ebf86b', 'volume_size': 1} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:17 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d1528f4-747d-4851-8670-d7b8ca45becf" returned: 0 in 0.668s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Lock "cinder-quobyte-6d1528f4-747d-4851-8670-d7b8ca45becf" released by "_copy_volume_from_snapshot" :: held 10.355s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Acquiring lock "cinder-quobyte-cdff9115-f96f-41fe-aa49-dd0a5346fe59" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Lock "cinder-quobyte-cdff9115-f96f-41fe-aa49-dd0a5346fe59" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Deleting offline snapshot cdff9115-f96f-41fe-aa49-dd0a5346fe59 of volume e7009aec-5bf1-42e7-b144-7170ab2d18fc {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] snapshot_file for this snap is: volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2fc01a-d170-41bb-85bd-6fd36844e4b8]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:18 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 Jun 28 14:23:18 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:18 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59" returned: 0 in 0.780s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:23:18 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[57644a89-965e-426c-ba7f-93f4a3c97137]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:18 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc Jun 28 14:23:18 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:19 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc" returned: 0 in 0.751s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:19 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 Jun 28 14:23:19 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:20 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59" returned: 0 in 0.695s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:20 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59 Jun 28 14:23:20 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:20 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc.cdff9115-f96f-41fe-aa49-dd0a5346fe59" returned: 0 in 0.638s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Lock "cinder-quobyte-cdff9115-f96f-41fe-aa49-dd0a5346fe59" released by "_delete_snapshot" :: held 2.949s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:23:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.770s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-e5bc4aa5-8acc-4dad-bbec-4db98a02716b req-001b4a80-e3fc-4356-9a45-945b7bf10186 tempest-ServerActionsTestOtherA-1135190114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.424s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:20 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[457b78eb-26cb-42e5-86b2-2d31c95449b2]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-e5bc4aa5-8acc-4dad-bbec-4db98a02716b req-001b4a80-e3fc-4356-9a45-945b7bf10186 tempest-ServerActionsTestOtherA-1135190114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:21 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-9b5cbe4d-453c-48fa-93e5-912d6eee48f5 tempest-GroupsV314Test-734898949 None] Create group from source-group-6c7ebc63-319b-4231-83b2-156398dfb949 completed successfully. Jun 28 14:23:21 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77 Jun 28 14:23:21 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:21 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-e5bc4aa5-8acc-4dad-bbec-4db98a02716b req-001b4a80-e3fc-4356-9a45-945b7bf10186 tempest-ServerActionsTestOtherA-1135190114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77" returned: 0 in 0.801s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-e5bc4aa5-8acc-4dad-bbec-4db98a02716b req-001b4a80-e3fc-4356-9a45-945b7bf10186 tempest-ServerActionsTestOtherA-1135190114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.821s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.202s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-129856794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e0d826-4351-423e-8493-8d2d98ebf86b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5226392366384f0cb511bd8be620b1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:23:17Z,use_quota=True,user_id='b5eb7564f34d4cfe8d850150213023d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:23:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Creating volume c7e0d826-4351-423e-8493-8d2d98ebf86b {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:23:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:23:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:23:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:23:21 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:23:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7e0d826-4351-423e-8493-8d2d98ebf86b 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:21 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7e0d826-4351-423e-8493-8d2d98ebf86b 1073741824 Jun 28 14:23:21 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e5bc4aa5-8acc-4dad-bbec-4db98a02716b req-001b4a80-e3fc-4356-9a45-945b7bf10186 tempest-ServerActionsTestOtherA-1135190114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-21eba21d-7964-497e-8968-a0dbcc0b2d77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d4a9c90-aaa0-4cb3-b680-3b7588787162', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:23:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Acquiring lock "cinder-quobyte-6d1528f4-747d-4851-8670-d7b8ca45becf" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:23:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Lock "cinder-quobyte-6d1528f4-747d-4851-8670-d7b8ca45becf" acquired by "delete_volume" :: waited 0.038s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:23:22 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f713ac-657e-47ad-bc92-6155dc402c00]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d1528f4-747d-4851-8670-d7b8ca45becf {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:22 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-e5bc4aa5-8acc-4dad-bbec-4db98a02716b req-001b4a80-e3fc-4356-9a45-945b7bf10186 tempest-ServerActionsTestOtherA-1135190114 None] attachment_update completed successfully. Jun 28 14:23:22 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d1528f4-747d-4851-8670-d7b8ca45becf Jun 28 14:23:22 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-b2ad27a5-3451-4183-9b02-536382d6319c req-e1147e1b-1c7f-4969-baeb-1b5d2d54975b tempest-TaggedAttachmentsTest-1980492223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:22 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7e0d826-4351-423e-8493-8d2d98ebf86b 1073741824" returned: 0 in 1.012s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7e0d826-4351-423e-8493-8d2d98ebf86b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:22 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7e0d826-4351-423e-8493-8d2d98ebf86b Jun 28 14:23:22 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:22 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d1528f4-747d-4851-8670-d7b8ca45becf" returned: 0 in 0.892s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d1528f4-747d-4851-8670-d7b8ca45becf {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:22 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d1528f4-747d-4851-8670-d7b8ca45becf Jun 28 14:23:22 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:23 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7e0d826-4351-423e-8493-8d2d98ebf86b" returned: 0 in 0.662s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-b2ad27a5-3451-4183-9b02-536382d6319c req-e1147e1b-1c7f-4969-baeb-1b5d2d54975b tempest-TaggedAttachmentsTest-1980492223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.264s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1b7fd4-641b-4f66-bb2e-dc197df28cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e0d826-4351-423e-8493-8d2d98ebf86b', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ca4f42-6627-454a-9b56-89368245a685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdca7f9-c5c0-4094-a10d-910356922318]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-b2ad27a5-3451-4183-9b02-536382d6319c req-e1147e1b-1c7f-4969-baeb-1b5d2d54975b tempest-TaggedAttachmentsTest-1980492223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e49107d7-a416-43d5-8dbf-b620f11baffa {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:23 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Volume volume-c7e0d826-4351-423e-8493-8d2d98ebf86b (c7e0d826-4351-423e-8493-8d2d98ebf86b): created successfully Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ca4f42-6627-454a-9b56-89368245a685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:23 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Flow 'volume_create_manager' (a617e574-4f76-4041-931f-63208d654fc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d1528f4-747d-4851-8670-d7b8ca45becf" returned: 0 in 0.685s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:23 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-9988f07e-c9ab-4202-9df1-8ffac5b72365 tempest-ServersNegativeTestJSON-960742028 None] Created volume successfully. Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Lock "cinder-quobyte-6d1528f4-747d-4851-8670-d7b8ca45becf" released by "delete_volume" :: held 1.634s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Created reservations ['9f647e99-179d-4355-90f1-e55d4ae11c0d'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:23:23 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e49107d7-a416-43d5-8dbf-b620f11baffa Jun 28 14:23:23 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:23 devstack cinder-volume[93561]: WARNING cinder.quota [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-759386658 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-759386658, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:23:23 devstack cinder-volume[93561]: WARNING cinder.quota [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-759386658 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-759386658, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Created reservations ['0357b36f-811f-4969-a470-0e94b13b1c1b', '43014992-849c-44d7-b4de-6da376693951', '06de5012-c445-4936-bd73-d2921c788ea4', '9749abb0-0a2e-416b-98a1-ee2bb8fb5869'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:23 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:23:23 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:24 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-b2ad27a5-3451-4183-9b02-536382d6319c req-e1147e1b-1c7f-4969-baeb-1b5d2d54975b tempest-TaggedAttachmentsTest-1980492223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e49107d7-a416-43d5-8dbf-b620f11baffa" returned: 0 in 0.957s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-b2ad27a5-3451-4183-9b02-536382d6319c req-e1147e1b-1c7f-4969-baeb-1b5d2d54975b tempest-TaggedAttachmentsTest-1980492223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.993s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-b2ad27a5-3451-4183-9b02-536382d6319c req-e1147e1b-1c7f-4969-baeb-1b5d2d54975b tempest-TaggedAttachmentsTest-1980492223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-e49107d7-a416-43d5-8dbf-b620f11baffa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f2f04aa-381e-47fb-a956-1a178ed6c1da', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:23:24 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] Acquiring lock "cinder-quobyte-e7009aec-5bf1-42e7-b144-7170ab2d18fc" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:23:24 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.720s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:24 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:23:24 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] Lock "cinder-quobyte-e7009aec-5bf1-42e7-b144-7170ab2d18fc" acquired by "delete_volume" :: waited 0.039s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:23:24 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-328c1f7d-09a7-411d-bbba-2ac0ae16a46e tempest-GroupsV314Test-734898949 None] Delete group completed successfully. Jun 28 14:23:24 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b38eaa9-b27c-44e5-9daa-3de5676e0d66]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:24 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-b2ad27a5-3451-4183-9b02-536382d6319c req-e1147e1b-1c7f-4969-baeb-1b5d2d54975b tempest-TaggedAttachmentsTest-1980492223 None] attachment_update completed successfully. Jun 28 14:23:24 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc Jun 28 14:23:24 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Flow 'volume_create_manager' (241c0edf-90c9-438e-b60f-7c5302414e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9691e225-81c4-412b-b0f8-697061fd9881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9691e225-81c4-412b-b0f8-697061fd9881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1182070080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5226392366384f0cb511bd8be620b1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:23:25Z,use_quota=True,user_id='b5eb7564f34d4cfe8d850150213023d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c561c2ae-8153-43b1-a603-9095973870e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c561c2ae-8153-43b1-a603-9095973870e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2694c59-f235-4485-8aa7-898af285dbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2694c59-f235-4485-8aa7-898af285dbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb', 'volume_name': 'volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c87b80c-af18-49d4-8814-cdee5f5d61dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c87b80c-af18-49d4-8814-cdee5f5d61dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dd74c2-4bb7-46ce-b4b9-deca3ce30701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:25 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Volume e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb', 'volume_size': 1} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1182070080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5226392366384f0cb511bd8be620b1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:23:25Z,use_quota=True,user_id='b5eb7564f34d4cfe8d850150213023d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Creating volume e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:23:25 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:25 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb 1073741824 Jun 28 14:23:25 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:25 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc" returned: 0 in 0.831s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:25 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc Jun 28 14:23:25 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:26 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e7009aec-5bf1-42e7-b144-7170ab2d18fc" returned: 0 in 0.685s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] Lock "cinder-quobyte-e7009aec-5bf1-42e7-b144-7170ab2d18fc" released by "delete_volume" :: held 1.599s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:23:26 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] Created reservations ['d3f1af44-49b5-46a8-989a-f1aace95532d'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:23:26 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] Created reservations ['f3f6dbba-b2c4-494d-8627-af04f5992d65', '4a26d3ca-e388-4ca6-aad2-f62a0e572847', 'c6e9e08e-739c-4c4f-b26d-1ea0fe8d1521', '0191c57b-3d25-42a1-bbda-fd8a1165eb0c'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:23:26 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb 1073741824" returned: 0 in 0.978s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:23:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:23:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:26 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb Jun 28 14:23:26 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:26 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:23:26 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:27 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:27 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.747s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:27 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:23:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb" returned: 0 in 0.779s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:23:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:27 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c26a0175-42b4-46ce-856f-f12fba7f88be tempest-GroupsV314Test-734898949 None] Delete group completed successfully. Jun 28 14:23:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dd74c2-4bb7-46ce-b4b9-deca3ce30701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f086ee94-2b9a-42b2-afce-f027b94ec044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:27 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Volume volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb (e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb): created successfully Jun 28 14:23:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f086ee94-2b9a-42b2-afce-f027b94ec044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Flow 'volume_create_manager' (241c0edf-90c9-438e-b60f-7c5302414e64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:23:27 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-479eb15d-a539-425e-9817-578280e29e2e tempest-ServersNegativeTestJSON-960742028 None] Created volume successfully. Jun 28 14:23:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Acquiring lock "cinder-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:23:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Lock "cinder-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:23:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Acquiring lock "cinder-quobyte-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:23:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Lock "cinder-quobyte-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:23:28 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc819da4-57c2-4114-af89-1080c51613fb]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:28 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb Jun 28 14:23:28 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb" returned: 0 in 0.997s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:29 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:29 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb Jun 28 14:23:29 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:29 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb" returned: 0 in 0.824s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Lock "cinder-quobyte-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb" released by "delete_volume" :: held 1.879s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:23:29 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Created reservations ['b8c26344-02c0-4f9b-a303-40563ca2e593', 'a8770d70-b45f-4654-a639-5af314bf15e5', '4a3857ba-68b9-4b5f-b423-a5055b6efc50', '95b0d8ff-26fa-40ea-8070-1968a034d3c1'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:23:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:23:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:23:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:30 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:23:30 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Acquiring lock "cinder-c7e0d826-4351-423e-8493-8d2d98ebf86b-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:23:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Lock "cinder-c7e0d826-4351-423e-8493-8d2d98ebf86b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:23:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Acquiring lock "cinder-quobyte-c7e0d826-4351-423e-8493-8d2d98ebf86b" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:23:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Lock "cinder-quobyte-c7e0d826-4351-423e-8493-8d2d98ebf86b" acquired by "delete_volume" :: waited 0.040s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:23:30 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f944c2-8d4d-4b2d-b58a-1427fa96f20a]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7e0d826-4351-423e-8493-8d2d98ebf86b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:30 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7e0d826-4351-423e-8493-8d2d98ebf86b Jun 28 14:23:30 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:31 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-82e4d2ac-1e3d-4340-9cc7-afc4c91d2abb req-826b293f-b410-4237-8290-b0e2abb5e984 tempest-ServerActionsTestOtherA-1135190114 None] Terminate volume connection completed successfully. Jun 28 14:23:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-82e4d2ac-1e3d-4340-9cc7-afc4c91d2abb req-826b293f-b410-4237-8290-b0e2abb5e984 tempest-ServerActionsTestOtherA-1135190114 None] Deleting attachment 1d4a9c90-aaa0-4cb3-b680-3b7588787162. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:23:31 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.212s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:31 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:23:31 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Deleted volume successfully. Jun 28 14:23:31 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ecc87b4b-d962-4442-bbcb-adc6853eb481 tempest-ServersNegativeTestJSON-960742028 None] Lock "cinder-e2c0e3ca-daf8-432a-9cf0-9bae411ee7cb-delete_volume" released by "delete_volume" :: held 3.519s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:23:32 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7e0d826-4351-423e-8493-8d2d98ebf86b" returned: 0 in 1.613s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7e0d826-4351-423e-8493-8d2d98ebf86b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:32 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7e0d826-4351-423e-8493-8d2d98ebf86b Jun 28 14:23:32 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:32 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7e0d826-4351-423e-8493-8d2d98ebf86b" returned: 0 in 0.743s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Lock "cinder-quobyte-c7e0d826-4351-423e-8493-8d2d98ebf86b" released by "delete_volume" :: held 2.442s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:23:32 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Created reservations ['91a7e8f7-9340-4d19-87ea-21421c072c48', 'd4f925ee-1614-4e15-89db-7a0b1510bbd9', '87e399a1-be82-49c5-9775-a226fa6774ff', '0d138adc-9978-4b02-ab2e-0036df6b8879'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:23:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:23:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:23:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:32 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:23:32 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:33 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-a3c764bb-b950-437c-96ba-c8b4d2425ebe req-6b61a96d-7e77-45f4-996d-96ad7c1ec5a9 tempest-TaggedAttachmentsTest-1980492223 None] Terminate volume connection completed successfully. Jun 28 14:23:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-a3c764bb-b950-437c-96ba-c8b4d2425ebe req-6b61a96d-7e77-45f4-996d-96ad7c1ec5a9 tempest-TaggedAttachmentsTest-1980492223 None] Deleting attachment 2f2f04aa-381e-47fb-a956-1a178ed6c1da. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:23:33 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.732s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:33 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:23:33 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Deleted volume successfully. Jun 28 14:23:33 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-897797c6-181a-4218-a9c6-c1c76dda5a2d tempest-ServersNegativeTestJSON-960742028 None] Lock "cinder-c7e0d826-4351-423e-8493-8d2d98ebf86b-delete_volume" released by "delete_volume" :: held 3.471s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-82e4d2ac-1e3d-4340-9cc7-afc4c91d2abb req-21527f05-0de6-4601-8afe-6afa1186bd25 tempest-ServerActionsTestOtherA-1135190114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-82e4d2ac-1e3d-4340-9cc7-afc4c91d2abb req-21527f05-0de6-4601-8afe-6afa1186bd25 tempest-ServerActionsTestOtherA-1135190114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c7ab59-c0c6-46bb-bde5-f62faaa3175f]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-82e4d2ac-1e3d-4340-9cc7-afc4c91d2abb req-21527f05-0de6-4601-8afe-6afa1186bd25 tempest-ServerActionsTestOtherA-1135190114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:34 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77 Jun 28 14:23:34 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Flow 'volume_create_manager' (90250edd-882f-44f1-8e1e-ab6e230e333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a1fb88-dea0-493a-8614-5ed892390b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a1fb88-dea0-493a-8614-5ed892390b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1385455646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e61009-dacf-4301-a255-74b84cc03148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684131b48f384771a8d812815ec68a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:23:35Z,use_quota=True,user_id='cf2114a7cc0d43f9af9b7ae00533d251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66752c3e-e283-4094-b8ea-47398cdf1c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66752c3e-e283-4094-b8ea-47398cdf1c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c454b9e-52fe-48af-bbc2-b8862c1ce0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c454b9e-52fe-48af-bbc2-b8862c1ce0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e61009-dacf-4301-a255-74b84cc03148', 'volume_name': 'volume-39e61009-dacf-4301-a255-74b84cc03148', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09aab9a8-f606-4bf3-a169-7187fe03f790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09aab9a8-f606-4bf3-a169-7187fe03f790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5505a59-78c6-4036-bbd9-57a788154392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:34 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Volume 39e61009-dacf-4301-a255-74b84cc03148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e61009-dacf-4301-a255-74b84cc03148', 'volume_size': 1} Jun 28 14:23:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:35 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-82e4d2ac-1e3d-4340-9cc7-afc4c91d2abb req-21527f05-0de6-4601-8afe-6afa1186bd25 tempest-ServerActionsTestOtherA-1135190114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77" returned: 0 in 1.030s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-82e4d2ac-1e3d-4340-9cc7-afc4c91d2abb req-21527f05-0de6-4601-8afe-6afa1186bd25 tempest-ServerActionsTestOtherA-1135190114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.046s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.407s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1385455646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e61009-dacf-4301-a255-74b84cc03148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684131b48f384771a8d812815ec68a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:23:35Z,use_quota=True,user_id='cf2114a7cc0d43f9af9b7ae00533d251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:23:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Creating volume 39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:23:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:23:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:23:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:23:35 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:23:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:35 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148 1073741824 Jun 28 14:23:35 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-82e4d2ac-1e3d-4340-9cc7-afc4c91d2abb req-21527f05-0de6-4601-8afe-6afa1186bd25 tempest-ServerActionsTestOtherA-1135190114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-21eba21d-7964-497e-8968-a0dbcc0b2d77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe4082b7-f765-420e-8031-020405d0162a', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:23:35 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-82e4d2ac-1e3d-4340-9cc7-afc4c91d2abb req-21527f05-0de6-4601-8afe-6afa1186bd25 tempest-ServerActionsTestOtherA-1135190114 None] attachment_update completed successfully. Jun 28 14:23:36 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148 1073741824" returned: 0 in 1.049s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:36 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148 Jun 28 14:23:36 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:37 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148" returned: 0 in 0.928s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:23:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5505a59-78c6-4036-bbd9-57a788154392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e61009-dacf-4301-a255-74b84cc03148', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f8696b-3037-42a9-a627-7712d8bec8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:23:37 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Volume volume-39e61009-dacf-4301-a255-74b84cc03148 (39e61009-dacf-4301-a255-74b84cc03148): created successfully Jun 28 14:23:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f8696b-3037-42a9-a627-7712d8bec8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:23:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Flow 'volume_create_manager' (90250edd-882f-44f1-8e1e-ab6e230e333e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:23:37 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-81c96187-7902-4cdc-8b2f-f1d724204775 tempest-SnapshotsActionsTest-120480439 None] Created volume successfully. Jun 28 14:23:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:23:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:23:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:23:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:37 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:23:37 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:38 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] Creating offline snapshot 03212e26-7912-489a-be67-9d5977e7d564 of volume 39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:23:38 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[533ba769-d35f-4cc3-ae6b-7179a50efb6e]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:38 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148 Jun 28 14:23:38 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:38 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.765s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:23:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:23:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 8 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:23:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:23:39 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148" returned: 0 in 0.849s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:39 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 1G Jun 28 14:23:39 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:40 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 1G" returned: 0 in 0.951s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e61009-dacf-4301-a255-74b84cc03148 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:40 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e61009-dacf-4301-a255-74b84cc03148 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 Jun 28 14:23:40 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e61009-dacf-4301-a255-74b84cc03148 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564" returned: 0 in 0.706s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:40 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 is being set with open permissions: ugo+rw Jun 28 14:23:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:40 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:40 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 Jun 28 14:23:40 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:41 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564" returned: 0 in 0.687s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:41 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.info Jun 28 14:23:41 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:42 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.info" returned: 0 in 1.110s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:42 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.info is being set with open permissions: ugo+rw Jun 28 14:23:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:42 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.info Jun 28 14:23:42 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:43 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.info" returned: 0 in 0.993s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.433s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:43 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-1506d729-4d4b-40ef-b2da-e7ac164e2f4a tempest-SnapshotsActionsTest-120480439 None] Create snapshot completed successfully Jun 28 14:23:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-958818c9-5e8c-4221-afcf-cc41dcf0ccfb tempest-SnapshotsActionsTest-120480439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-958818c9-5e8c-4221-afcf-cc41dcf0ccfb tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-958818c9-5e8c-4221-afcf-cc41dcf0ccfb tempest-SnapshotsActionsTest-120480439 None] Creating offline snapshot b3760dbd-cbf4-4a33-b2ee-994914f4c76a of volume 39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:23:45 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[414da220-cedd-457f-8d7c-16a447222eb9]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-958818c9-5e8c-4221-afcf-cc41dcf0ccfb tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:46 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 Jun 28 14:23:46 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:47 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-958818c9-5e8c-4221-afcf-cc41dcf0ccfb tempest-SnapshotsActionsTest-120480439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564" returned: 0 in 1.116s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-958818c9-5e8c-4221-afcf-cc41dcf0ccfb tempest-SnapshotsActionsTest-120480439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e61009-dacf-4301-a255-74b84cc03148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:23:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-958818c9-5e8c-4221-afcf-cc41dcf0ccfb tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:47 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a 1G Jun 28 14:23:47 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:48 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-958818c9-5e8c-4221-afcf-cc41dcf0ccfb tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a 1G" returned: 0 in 1.148s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-958818c9-5e8c-4221-afcf-cc41dcf0ccfb tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:48 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a Jun 28 14:23:48 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:49 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-958818c9-5e8c-4221-afcf-cc41dcf0ccfb tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a" returned: 0 in 0.938s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:49 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-958818c9-5e8c-4221-afcf-cc41dcf0ccfb tempest-SnapshotsActionsTest-120480439 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a is being set with open permissions: ugo+rw Jun 28 14:23:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-958818c9-5e8c-4221-afcf-cc41dcf0ccfb tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:49 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a Jun 28 14:23:49 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:49 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-958818c9-5e8c-4221-afcf-cc41dcf0ccfb tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a" returned: 0 in 0.708s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-958818c9-5e8c-4221-afcf-cc41dcf0ccfb tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.077s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:49 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-958818c9-5e8c-4221-afcf-cc41dcf0ccfb tempest-SnapshotsActionsTest-120480439 None] Create snapshot completed successfully Jun 28 14:23:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Acquiring lock "cinder-b3760dbd-cbf4-4a33-b2ee-994914f4c76a-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:23:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-b3760dbd-cbf4-4a33-b2ee-994914f4c76a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:23:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Acquiring lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:23:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:23:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Acquiring lock "cinder-quobyte-b3760dbd-cbf4-4a33-b2ee-994914f4c76a" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:23:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-b3760dbd-cbf4-4a33-b2ee-994914f4c76a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:23:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Deleting offline snapshot b3760dbd-cbf4-4a33-b2ee-994914f4c76a of volume 39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:23:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] snapshot_file for this snap is: volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:23:50 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[057f1024-60e0-44d1-a856-286798a22474]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:50 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a Jun 28 14:23:50 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:51 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a" returned: 0 in 1.038s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e61009-dacf-4301-a255-74b84cc03148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:23:51 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56200c7-4a9e-4e6e-8516-bfeeeb820537]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:51 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 Jun 28 14:23:51 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:52 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564" returned: 0 in 0.984s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e61009-dacf-4301-a255-74b84cc03148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:23:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:52 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a Jun 28 14:23:52 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:53 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a" returned: 0 in 1.128s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:53 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a Jun 28 14:23:53 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Acquiring lock "cinder-e49107d7-a416-43d5-8dbf-b620f11baffa-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:23:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Lock "cinder-e49107d7-a416-43d5-8dbf-b620f11baffa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:23:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Acquiring lock "cinder-quobyte-e49107d7-a416-43d5-8dbf-b620f11baffa" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:23:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Lock "cinder-quobyte-e49107d7-a416-43d5-8dbf-b620f11baffa" acquired by "delete_volume" :: waited 0.026s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:23:54 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20afa3d-3d0a-481f-be57-0f9bf7783af6]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e49107d7-a416-43d5-8dbf-b620f11baffa {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:54 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.b3760dbd-cbf4-4a33-b2ee-994914f4c76a" returned: 0 in 0.903s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-b3760dbd-cbf4-4a33-b2ee-994914f4c76a" released by "_delete_snapshot" :: held 4.178s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:23:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" released by "delete_snapshot" :: held 4.211s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:23:54 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e49107d7-a416-43d5-8dbf-b620f11baffa Jun 28 14:23:54 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:54 devstack cinder-volume[93561]: WARNING cinder.quota [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:23:54 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Created reservations ['0f1602fe-cdba-44dd-b6dc-ff4ee4fb6f4f', 'dd360032-3076-4412-8fb6-56c8a1ccabdb', 'a0ba0ed0-8ec6-43ca-bb12-a6d5ca6d76bb', '6ad850ed-f93d-4b7a-b508-9d25e9ff15db'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:23:54 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Delete snapshot completed successfully. Jun 28 14:23:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-54128184-9f29-4c82-b52c-c8109b273439 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-b3760dbd-cbf4-4a33-b2ee-994914f4c76a-delete_snapshot" released by "delete_snapshot" :: held 4.428s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:23:55 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e49107d7-a416-43d5-8dbf-b620f11baffa" returned: 0 in 0.847s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e49107d7-a416-43d5-8dbf-b620f11baffa {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:55 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e49107d7-a416-43d5-8dbf-b620f11baffa Jun 28 14:23:55 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-55e872de-6afa-4b3e-8092-d8b615dce379 tempest-SnapshotsActionsTest-120480439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-55e872de-6afa-4b3e-8092-d8b615dce379 tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-55e872de-6afa-4b3e-8092-d8b615dce379 tempest-SnapshotsActionsTest-120480439 None] Creating offline snapshot d924914a-6b7f-4440-a07a-e102dae10b8f of volume 39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:23:56 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a63d75-c2e4-4ae6-b992-7d9c91e95582]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:23:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-55e872de-6afa-4b3e-8092-d8b615dce379 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:56 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e49107d7-a416-43d5-8dbf-b620f11baffa" returned: 0 in 1.297s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Lock "cinder-quobyte-e49107d7-a416-43d5-8dbf-b620f11baffa" released by "delete_volume" :: held 2.244s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:23:56 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 Jun 28 14:23:56 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:56 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Created reservations ['bd85c0bf-da12-4b7c-9f3c-0984868e139b', '012f2034-b9dd-4a82-acd7-ae3551ced230', 'd7a46a0e-2e82-423b-9089-f00ecb3a6351', 'df51dd1c-0cea-4b2d-9583-509e69703af7'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:23:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:23:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:23:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:23:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:23:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:23:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:56 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:23:56 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:57 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-55e872de-6afa-4b3e-8092-d8b615dce379 tempest-SnapshotsActionsTest-120480439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564" returned: 0 in 1.044s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-55e872de-6afa-4b3e-8092-d8b615dce379 tempest-SnapshotsActionsTest-120480439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e61009-dacf-4301-a255-74b84cc03148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:23:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-55e872de-6afa-4b3e-8092-d8b615dce379 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:57 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f 1G Jun 28 14:23:57 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:57 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.772s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:57 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:23:57 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Deleted volume successfully. Jun 28 14:23:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9817b26f-d9f9-4939-9209-489817f07294 tempest-TaggedAttachmentsTest-1980492223 None] Lock "cinder-e49107d7-a416-43d5-8dbf-b620f11baffa-delete_volume" released by "delete_volume" :: held 3.314s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:23:58 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-55e872de-6afa-4b3e-8092-d8b615dce379 tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f 1G" returned: 0 in 1.069s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-55e872de-6afa-4b3e-8092-d8b615dce379 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:58 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f Jun 28 14:23:58 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:23:59 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Jun 28 14:23:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-55e872de-6afa-4b3e-8092-d8b615dce379 tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f" returned: 0 in 0.752s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:23:59 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-55e872de-6afa-4b3e-8092-d8b615dce379 tempest-SnapshotsActionsTest-120480439 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f is being set with open permissions: ugo+rw Jun 28 14:23:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-55e872de-6afa-4b3e-8092-d8b615dce379 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:23:59 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f Jun 28 14:23:59 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:00 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-55e872de-6afa-4b3e-8092-d8b615dce379 tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f" returned: 0 in 0.726s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-55e872de-6afa-4b3e-8092-d8b615dce379 tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.759s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:24:00 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-55e872de-6afa-4b3e-8092-d8b615dce379 tempest-SnapshotsActionsTest-120480439 None] Create snapshot completed successfully Jun 28 14:24:00 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Acquiring lock "cinder-d924914a-6b7f-4440-a07a-e102dae10b8f-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:00 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-d924914a-6b7f-4440-a07a-e102dae10b8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:00 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Acquiring lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Acquiring lock "cinder-quobyte-d924914a-6b7f-4440-a07a-e102dae10b8f" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-d924914a-6b7f-4440-a07a-e102dae10b8f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Deleting offline snapshot d924914a-6b7f-4440-a07a-e102dae10b8f of volume 39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:24:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] snapshot_file for this snap is: volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:24:01 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e02be7-e36f-4d03-9a07-b36b4b2e7309]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:24:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:01 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f Jun 28 14:24:01 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:01 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f" returned: 0 in 0.907s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e61009-dacf-4301-a255-74b84cc03148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:24:02 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6ec2e2-e62c-48dc-bcc1-fce95bc201c8]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:24:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:02 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 Jun 28 14:24:02 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:03 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564" returned: 0 in 1.065s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e61009-dacf-4301-a255-74b84cc03148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:24:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:03 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f Jun 28 14:24:03 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:04 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f" returned: 0 in 1.074s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:04 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f Jun 28 14:24:04 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:05 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.d924914a-6b7f-4440-a07a-e102dae10b8f" returned: 0 in 0.916s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-d924914a-6b7f-4440-a07a-e102dae10b8f" released by "_delete_snapshot" :: held 4.113s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" released by "delete_snapshot" :: held 4.156s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:05 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Created reservations ['ea218847-36df-40e8-8be4-a808a64be628', '95a2f57d-0787-4a6b-9315-3e725f8a55d3', '8aa2d735-72a7-40f9-9489-102fe3473492', 'b9f98cdb-c0a2-4144-8c1c-a43f71ade7cd'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:24:05 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Delete snapshot completed successfully. Jun 28 14:24:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-be63936e-83c5-4111-83d4-6831645c27e9 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-d924914a-6b7f-4440-a07a-e102dae10b8f-delete_snapshot" released by "delete_snapshot" :: held 4.364s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8bc166df-7449-4999-ad8d-720c543ce513 tempest-SnapshotsActionsTest-120480439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:24:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8bc166df-7449-4999-ad8d-720c543ce513 tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:24:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-8bc166df-7449-4999-ad8d-720c543ce513 tempest-SnapshotsActionsTest-120480439 None] Creating offline snapshot 24ac6007-fa96-4b98-b4f7-8293c7473c2e of volume 39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:24:06 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[876c523e-5cd8-4214-86ed-a5f5b4c20dbf]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:24:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8bc166df-7449-4999-ad8d-720c543ce513 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:07 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 Jun 28 14:24:07 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:08 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8bc166df-7449-4999-ad8d-720c543ce513 tempest-SnapshotsActionsTest-120480439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564" returned: 0 in 1.307s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-8bc166df-7449-4999-ad8d-720c543ce513 tempest-SnapshotsActionsTest-120480439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e61009-dacf-4301-a255-74b84cc03148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:24:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8bc166df-7449-4999-ad8d-720c543ce513 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:08 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e 1G Jun 28 14:24:08 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8bc166df-7449-4999-ad8d-720c543ce513 tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e 1G" returned: 0 in 1.217s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:09 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8bc166df-7449-4999-ad8d-720c543ce513 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:09 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e Jun 28 14:24:09 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:09 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-2fa11ea9-437c-42c3-bc03-110c60236242 req-1b6fb1df-a53b-49c1-abe6-ecd81596a73a tempest-ServerActionsTestOtherA-1135190114 None] Terminate volume connection completed successfully. Jun 28 14:24:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-2fa11ea9-437c-42c3-bc03-110c60236242 req-1b6fb1df-a53b-49c1-abe6-ecd81596a73a tempest-ServerActionsTestOtherA-1135190114 None] Deleting attachment fe4082b7-f765-420e-8031-020405d0162a. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:24:10 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8bc166df-7449-4999-ad8d-720c543ce513 tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e" returned: 0 in 0.830s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:10 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-8bc166df-7449-4999-ad8d-720c543ce513 tempest-SnapshotsActionsTest-120480439 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e is being set with open permissions: ugo+rw Jun 28 14:24:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8bc166df-7449-4999-ad8d-720c543ce513 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:10 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e Jun 28 14:24:10 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:10 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8bc166df-7449-4999-ad8d-720c543ce513 tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e" returned: 0 in 0.679s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8bc166df-7449-4999-ad8d-720c543ce513 tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.185s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:24:11 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-8bc166df-7449-4999-ad8d-720c543ce513 tempest-SnapshotsActionsTest-120480439 None] Create snapshot completed successfully Jun 28 14:24:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Acquiring lock "cinder-24ac6007-fa96-4b98-b4f7-8293c7473c2e-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-24ac6007-fa96-4b98-b4f7-8293c7473c2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Acquiring lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Acquiring lock "cinder-quobyte-24ac6007-fa96-4b98-b4f7-8293c7473c2e" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-24ac6007-fa96-4b98-b4f7-8293c7473c2e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Deleting offline snapshot 24ac6007-fa96-4b98-b4f7-8293c7473c2e of volume 39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:24:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] snapshot_file for this snap is: volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:24:12 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a9bb16-a24e-47b6-b3c5-9d39e2a67b3d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:24:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:12 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e Jun 28 14:24:12 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:13 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e" returned: 0 in 1.079s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e61009-dacf-4301-a255-74b84cc03148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:24:13 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea6a68e-0daf-4612-984b-33c77cef14be]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:24:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:13 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 Jun 28 14:24:13 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:14 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564" returned: 0 in 0.971s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e61009-dacf-4301-a255-74b84cc03148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:24:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:14 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e Jun 28 14:24:14 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:15 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e" returned: 0 in 0.920s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:15 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e Jun 28 14:24:15 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:16 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.24ac6007-fa96-4b98-b4f7-8293c7473c2e" returned: 0 in 0.840s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:16 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-24ac6007-fa96-4b98-b4f7-8293c7473c2e" released by "_delete_snapshot" :: held 4.037s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:16 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" released by "delete_snapshot" :: held 4.061s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:16 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Created reservations ['d9ca8fa2-2385-4ecc-949e-7346cb171afa', '0adcdfe1-9f78-46f4-a934-50fdccf79b1b', 'f7c4fa6f-e1b0-4890-9f67-df1aada174b1', '90c0e490-3da6-4875-aa6c-311392b356d7'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:24:16 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=88,cinder:UPDATE=74,cinder:INSERT=15,cinder:DELETE=7 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:24:16 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=77,cinder:UPDATE=91,cinder:INSERT=23,cinder:DELETE=3 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:24:16 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Delete snapshot completed successfully. Jun 28 14:24:16 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-582b3d71-dec8-40e2-89bc-161f5cf110e7 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-24ac6007-fa96-4b98-b4f7-8293c7473c2e-delete_snapshot" released by "delete_snapshot" :: held 4.300s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d0ebff06-2135-46a7-bdbc-0600be7d5766 tempest-SnapshotsActionsTest-120480439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:24:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d0ebff06-2135-46a7-bdbc-0600be7d5766 tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:24:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-d0ebff06-2135-46a7-bdbc-0600be7d5766 tempest-SnapshotsActionsTest-120480439 None] Creating offline snapshot ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca of volume 39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:24:18 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bd8a60-4797-4213-a2ea-96281c9948af]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:24:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d0ebff06-2135-46a7-bdbc-0600be7d5766 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:18 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 Jun 28 14:24:18 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:19 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d0ebff06-2135-46a7-bdbc-0600be7d5766 tempest-SnapshotsActionsTest-120480439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564" returned: 0 in 0.897s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:19 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-d0ebff06-2135-46a7-bdbc-0600be7d5766 tempest-SnapshotsActionsTest-120480439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e61009-dacf-4301-a255-74b84cc03148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:24:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d0ebff06-2135-46a7-bdbc-0600be7d5766 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:19 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca 1G Jun 28 14:24:19 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:20 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d0ebff06-2135-46a7-bdbc-0600be7d5766 tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca 1G" returned: 0 in 1.097s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d0ebff06-2135-46a7-bdbc-0600be7d5766 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:20 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca Jun 28 14:24:20 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:21 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d0ebff06-2135-46a7-bdbc-0600be7d5766 tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca" returned: 0 in 0.937s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:21 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-d0ebff06-2135-46a7-bdbc-0600be7d5766 tempest-SnapshotsActionsTest-120480439 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca is being set with open permissions: ugo+rw Jun 28 14:24:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d0ebff06-2135-46a7-bdbc-0600be7d5766 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:21 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca Jun 28 14:24:21 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:21 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d0ebff06-2135-46a7-bdbc-0600be7d5766 tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca" returned: 0 in 0.754s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d0ebff06-2135-46a7-bdbc-0600be7d5766 tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.826s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:24:21 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-d0ebff06-2135-46a7-bdbc-0600be7d5766 tempest-SnapshotsActionsTest-120480439 None] Create snapshot completed successfully Jun 28 14:24:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Acquiring lock "cinder-ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Acquiring lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Acquiring lock "cinder-quobyte-ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Deleting offline snapshot ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca of volume 39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:24:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] snapshot_file for this snap is: volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:24:22 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be5df04-a15f-4a3a-a570-391652714881]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:24:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:22 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca Jun 28 14:24:22 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:23 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Acquiring lock "cinder-21eba21d-7964-497e-8968-a0dbcc0b2d77-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:23 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Lock "cinder-21eba21d-7964-497e-8968-a0dbcc0b2d77-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:23 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Acquiring lock "cinder-quobyte-21eba21d-7964-497e-8968-a0dbcc0b2d77" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:23 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Lock "cinder-quobyte-21eba21d-7964-497e-8968-a0dbcc0b2d77" acquired by "delete_volume" :: waited 0.020s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:23 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eb8708-7b2b-4b31-b000-63460d679567]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:24:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:23 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77 Jun 28 14:24:23 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:23 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca" returned: 0 in 0.862s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e61009-dacf-4301-a255-74b84cc03148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:24:23 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[267913e5-30e2-4fd0-9733-0c3b51ba3818]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:24:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:23 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 Jun 28 14:24:23 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:24 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77" returned: 0 in 0.970s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:24 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77 Jun 28 14:24:24 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:24 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564" returned: 0 in 0.905s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e61009-dacf-4301-a255-74b84cc03148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:24:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:24 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca Jun 28 14:24:24 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:24 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-21eba21d-7964-497e-8968-a0dbcc0b2d77" returned: 0 in 0.737s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Lock "cinder-quobyte-21eba21d-7964-497e-8968-a0dbcc0b2d77" released by "delete_volume" :: held 1.764s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:25 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Created reservations ['5ec57898-0a82-4923-9f66-226051bf5029', '9c7cf79a-7732-49b4-b5ac-c7a0732df05b', '0dd05308-98a8-47ea-b71b-d504ddb145fe', '49ea70da-bc07-469b-96f0-056559daddb5'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:24:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:24:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:24:25 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:24:25 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:24:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:24:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:25 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:24:25 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:25 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca" returned: 0 in 0.932s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:25 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca Jun 28 14:24:25 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:25 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.756s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:25 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:24:25 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Deleted volume successfully. Jun 28 14:24:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-09932001-7fd2-4678-822a-b4e87740c5ee tempest-ServerActionsTestOtherA-1135190114 None] Lock "cinder-21eba21d-7964-497e-8968-a0dbcc0b2d77-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:26 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca" returned: 0 in 0.839s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca" released by "_delete_snapshot" :: held 3.652s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" released by "delete_snapshot" :: held 3.698s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:26 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Created reservations ['14c90137-5035-4955-a91e-b09d30d5d131', '74128004-c5ad-4005-971a-a3df8a206dd6', 'b5054bac-e23a-4024-95ef-5f5a255fcef3', '43335efc-2481-4403-a743-2da65df60f4e'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:24:26 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Delete snapshot completed successfully. Jun 28 14:24:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-509924aa-3f97-4493-ad72-5e21057e3f33 tempest-SnapshotsActionsTest-1812272739 None] Lock "cinder-ed6fffe8-bb7f-4e55-af8a-49f2ebf08cca-delete_snapshot" released by "delete_snapshot" :: held 3.844s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Acquiring lock "cinder-03212e26-7912-489a-be67-9d5977e7d564-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Lock "cinder-03212e26-7912-489a-be67-9d5977e7d564-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Acquiring lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Acquiring lock "cinder-quobyte-03212e26-7912-489a-be67-9d5977e7d564" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Lock "cinder-quobyte-03212e26-7912-489a-be67-9d5977e7d564" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Deleting offline snapshot 03212e26-7912-489a-be67-9d5977e7d564 of volume 39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:24:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] snapshot_file for this snap is: volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:24:27 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a08174-90ec-4a1f-b6c1-0ccacd1484aa]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:24:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:27 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 Jun 28 14:24:27 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:28 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564" returned: 0 in 1.291s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e61009-dacf-4301-a255-74b84cc03148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:24:28 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a9120c-ece6-4b30-bd32-d96266031025]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:24:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:28 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148 Jun 28 14:24:28 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:29 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148" returned: 0 in 1.165s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:29 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 Jun 28 14:24:29 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:31 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564" returned: 0 in 1.333s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:31 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564 Jun 28 14:24:31 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:32 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148.03212e26-7912-489a-be67-9d5977e7d564" returned: 0 in 0.916s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Lock "cinder-quobyte-03212e26-7912-489a-be67-9d5977e7d564" released by "_delete_snapshot" :: held 4.905s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" released by "delete_snapshot" :: held 4.950s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:32 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Created reservations ['fa1df1f0-5891-4bb2-b332-fbdad4744b56', '43e4084a-55fe-44fb-b50f-64733699f925', '591097c2-8745-492a-a89d-7dd591a4bd26', '537bde1c-10f3-41f9-82b1-31330880fedf'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:24:32 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Delete snapshot completed successfully. Jun 28 14:24:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d6ffb647-c753-4f58-8612-8f9cdf9693df tempest-SnapshotsActionsTest-120480439 None] Lock "cinder-03212e26-7912-489a-be67-9d5977e7d564-delete_snapshot" released by "delete_snapshot" :: held 5.325s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Acquiring lock "cinder-39e61009-dacf-4301-a255-74b84cc03148-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Lock "cinder-39e61009-dacf-4301-a255-74b84cc03148-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Acquiring lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:24:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" acquired by "delete_volume" :: waited 0.029s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:24:33 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8134a130-a3ca-4604-b861-7e92fc77918a]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:24:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:33 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148 Jun 28 14:24:33 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:34 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148" returned: 0 in 1.293s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:34 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148 Jun 28 14:24:34 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:35 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-39e61009-dacf-4301-a255-74b84cc03148" returned: 0 in 1.003s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Lock "cinder-quobyte-39e61009-dacf-4301-a255-74b84cc03148" released by "delete_volume" :: held 2.436s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:35 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Created reservations ['d47d6831-a6ed-4633-85c7-9977cebbb450', 'fdae9a90-be8b-4cd8-8f66-97fccc6ab4d5', 'a90a0e33-be3a-4803-8b8a-d8e801db8545', '557eb885-2d31-48fc-b79d-ca37c2fd22c2'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:24:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:24:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:24:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:24:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:24:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:24:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:35 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:24:35 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:36 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.035s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:36 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:24:36 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Deleted volume successfully. Jun 28 14:24:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-655981c1-387e-4f25-8be8-9ee5753cb8e5 tempest-SnapshotsActionsTest-120480439 None] Lock "cinder-39e61009-dacf-4301-a255-74b84cc03148-delete_volume" released by "delete_volume" :: held 3.800s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:24:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:24:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:24:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:24:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:24:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:24:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:24:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:37 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:24:37 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:38 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.158s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:24:45 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=28,cinder:DELETE=2,cinder:INSERT=10,cinder:UPDATE=26 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:24:46 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:UPDATE=32,cinder:SELECT=17,cinder:INSERT=6,cinder:DELETE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Flow 'volume_create_manager' (f4297d69-9d4b-4f22-85d6-06976c5c8ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd03f596-b8bc-4127-85ac-ce374cb5c148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd03f596-b8bc-4127-85ac-ce374cb5c148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1262320098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26bbefd5188e466f8db59f859e73972d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:24:55Z,use_quota=True,user_id='404de3da04f544b29cbeb71665bebd4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb414f6-365d-451f-ad93-44045d45e286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb414f6-365d-451f-ad93-44045d45e286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56a134a-6e3d-464f-9514-e31ad60080a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56a134a-6e3d-464f-9514-e31ad60080a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc', 'volume_name': 'volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988c0bb1-f2d5-43c9-8765-1d17236daab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988c0bb1-f2d5-43c9-8765-1d17236daab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287b6265-a2a1-432a-af04-74e4ad379967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:24:55 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Volume ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc', 'volume_size': 1} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1262320098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26bbefd5188e466f8db59f859e73972d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:24:55Z,use_quota=True,user_id='404de3da04f544b29cbeb71665bebd4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Creating volume ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:24:55 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:24:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:55 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc 1073741824 Jun 28 14:24:55 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:56 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:24:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Flow 'volume_create_manager' (975f7c8b-fd81-47ca-b7e6-bb806340a913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:24:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa857691-8aa7-4f4a-9c92-ed4f0b8e9edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:24:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa857691-8aa7-4f4a-9c92-ed4f0b8e9edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2147196104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a047cc1eb39c4ee69257e9820f4d1223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:24:56Z,use_quota=True,user_id='09fd04af8a3a42ec8c7c2587bebb932c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:24:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63912739-4182-470e-bfe8-c53ca2a80938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:24:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63912739-4182-470e-bfe8-c53ca2a80938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:24:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2fe0fc2-e7fe-430c-b3ff-2e22cf70f5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:24:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2fe0fc2-e7fe-430c-b3ff-2e22cf70f5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb', 'volume_name': 'volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:24:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc60408c-20b2-495a-8a37-9af55e908f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:24:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc60408c-20b2-495a-8a37-9af55e908f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:24:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc0650a-e4d1-4961-bfb8-2a95625ccf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:24:56 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Volume 64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb', 'volume_size': 1} Jun 28 14:24:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:24:56 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc 1073741824" returned: 0 in 0.970s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:56 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc Jun 28 14:24:56 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:57 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc" returned: 0 in 0.693s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.027s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2147196104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a047cc1eb39c4ee69257e9820f4d1223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:24:56Z,use_quota=True,user_id='09fd04af8a3a42ec8c7c2587bebb932c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Creating volume 64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:24:57 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:57 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb 1073741824 Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287b6265-a2a1-432a-af04-74e4ad379967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:24:57 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e28b6b5-4902-428e-9269-69b441cb69b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:24:57 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Volume volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc (ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc): created successfully Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e28b6b5-4902-428e-9269-69b441cb69b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:24:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Flow 'volume_create_manager' (f4297d69-9d4b-4f22-85d6-06976c5c8ebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:24:57 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-b920252e-cd55-47af-8bfb-1da30e4f0d43 tempest-AttachVolumeShelveTestJSON-733682715 None] Created volume successfully. Jun 28 14:24:58 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb 1073741824" returned: 0 in 1.068s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:24:58 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb Jun 28 14:24:58 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:24:59 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Jun 28 14:24:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb" returned: 0 in 0.742s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:24:59 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:24:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:24:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc0650a-e4d1-4961-bfb8-2a95625ccf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:24:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d03685-f971-4e5b-8a80-c053c4717eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:24:59 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Volume volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb (64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb): created successfully Jun 28 14:24:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d03685-f971-4e5b-8a80-c053c4717eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:24:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Flow 'volume_create_manager' (975f7c8b-fd81-47ca-b7e6-bb806340a913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:24:59 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-0ebb9089-036d-4d94-b7fe-4078b3bad2c7 tempest-VolumeQuotasNegativeTestJSON-971160775 None] Created volume successfully. Jun 28 14:25:02 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Acquiring lock "cinder-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:25:02 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Lock "cinder-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:25:02 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Acquiring lock "cinder-quobyte-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:25:02 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Lock "cinder-quobyte-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb" acquired by "delete_volume" :: waited 0.025s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:25:02 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc536bd4-375f-4daf-bce9-5578393239f0]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:25:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:02 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb Jun 28 14:25:02 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:03 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb" returned: 0 in 1.082s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:03 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb Jun 28 14:25:03 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:04 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb" returned: 0 in 0.796s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:04 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Lock "cinder-quobyte-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb" released by "delete_volume" :: held 1.950s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:25:04 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Created reservations ['b16ac928-5b78-4621-894c-01c27ec1f306', '8edd51ef-4556-4a0c-8edb-3048c913a4c6', '41e9ec46-f815-41f1-99d8-92f677850ae9', '60148da6-fb92-4c72-b5b4-a4b1ab908761'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:25:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:25:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:25:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:25:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:25:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:25:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:04 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:25:04 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:05 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.840s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:05 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:25:05 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Deleted volume successfully. Jun 28 14:25:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4a6799c2-c04f-4c98-b2c1-1d7c82eaad1f tempest-VolumeQuotasNegativeTestJSON-971160775 None] Lock "cinder-64d9ddb6-2ee5-40d1-9d81-60f4f9ce76eb-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Flow 'volume_create_manager' (5d83abbd-dfc3-4056-bc88-7b1c92ea02d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639dcbc6-cbb6-4fc5-9f88-9bca66fe542b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639dcbc6-cbb6-4fc5-9f88-9bca66fe542b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-170380431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58fb19d3-b425-4a45-a137-2937cbd4ce70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53b03d920b944498c5123d7442675b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:25:07Z,use_quota=True,user_id='d012956dda804bae870abbb79898d029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd31cc20-55e2-41cc-8a44-b82068bb9bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd31cc20-55e2-41cc-8a44-b82068bb9bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90f4b7a-a31c-4f41-9e5b-6d29c0cf9045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90f4b7a-a31c-4f41-9e5b-6d29c0cf9045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58fb19d3-b425-4a45-a137-2937cbd4ce70', 'volume_name': 'volume-58fb19d3-b425-4a45-a137-2937cbd4ce70', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6af7fc-6d7d-43c1-a9b1-e59077d581ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6af7fc-6d7d-43c1-a9b1-e59077d581ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023d8673-9329-4b27-83f8-c9aaa01cd6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:07 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Volume 58fb19d3-b425-4a45-a137-2937cbd4ce70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58fb19d3-b425-4a45-a137-2937cbd4ce70', 'volume_size': 1} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-170380431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58fb19d3-b425-4a45-a137-2937cbd4ce70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53b03d920b944498c5123d7442675b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:25:07Z,use_quota=True,user_id='d012956dda804bae870abbb79898d029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Creating volume 58fb19d3-b425-4a45-a137-2937cbd4ce70 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:25:07 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:25:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-58fb19d3-b425-4a45-a137-2937cbd4ce70 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:07 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-58fb19d3-b425-4a45-a137-2937cbd4ce70 1073741824 Jun 28 14:25:07 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:08 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-58fb19d3-b425-4a45-a137-2937cbd4ce70 1073741824" returned: 0 in 1.058s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-58fb19d3-b425-4a45-a137-2937cbd4ce70 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:08 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-58fb19d3-b425-4a45-a137-2937cbd4ce70 Jun 28 14:25:08 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:09 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-58fb19d3-b425-4a45-a137-2937cbd4ce70" returned: 0 in 0.850s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] <== create_volume: return (1965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:25:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:25:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023d8673-9329-4b27-83f8-c9aaa01cd6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58fb19d3-b425-4a45-a137-2937cbd4ce70', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0faec933-fe15-4a2a-8702-6034f90383a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:09 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Volume volume-58fb19d3-b425-4a45-a137-2937cbd4ce70 (58fb19d3-b425-4a45-a137-2937cbd4ce70): created successfully Jun 28 14:25:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0faec933-fe15-4a2a-8702-6034f90383a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Flow 'volume_create_manager' (5d83abbd-dfc3-4056-bc88-7b1c92ea02d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:25:09 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c52e3986-f558-4bdd-b22d-a27e09b3138a tempest-AttachVolumeNegativeTest-1777782759 None] Created volume successfully. Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Flow 'volume_create_manager' (fc74a353-f33a-411b-a449-b06e80a7803f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1c186f-77e1-454a-8d52-b36864083632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1c186f-77e1-454a-8d52-b36864083632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1605399423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff864b9-d81d-4152-8651-ca1b16aa9c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e41c83fe6d4975a1f9a195656dfc5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:25:12Z,use_quota=True,user_id='89e76d99c0b743068720ea26280c31aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a438ffcb-d6de-4deb-8dc7-a39e60933579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a438ffcb-d6de-4deb-8dc7-a39e60933579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136b9603-ac39-4760-8831-ca8f55ad84fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136b9603-ac39-4760-8831-ca8f55ad84fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bff864b9-d81d-4152-8651-ca1b16aa9c0e', 'volume_name': 'volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403f5582-3f22-4f1a-bfd5-482c2d5a46ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403f5582-3f22-4f1a-bfd5-482c2d5a46ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65310f8-85a0-461b-b75f-7de031ebba48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:12 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Volume bff864b9-d81d-4152-8651-ca1b16aa9c0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e', 'volume_size': 1} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1605399423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff864b9-d81d-4152-8651-ca1b16aa9c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e41c83fe6d4975a1f9a195656dfc5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:25:12Z,use_quota=True,user_id='89e76d99c0b743068720ea26280c31aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Creating volume bff864b9-d81d-4152-8651-ca1b16aa9c0e {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:25:12 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:25:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:12 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e 1073741824 Jun 28 14:25:12 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e 1073741824" returned: 0 in 1.124s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:13 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:13 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e Jun 28 14:25:13 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-1e5782be-9428-4bd2-be48-7a03a1d77cfe req-5d0e5c2e-abd2-4537-8929-f610e53c3d90 tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:25:14 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e" returned: 0 in 1.054s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] <== create_volume: return (2253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:25:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.261s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:25:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-1e5782be-9428-4bd2-be48-7a03a1d77cfe req-5d0e5c2e-abd2-4537-8929-f610e53c3d90 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.154s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:25:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65310f8-85a0-461b-b75f-7de031ebba48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6636f235-a613-4099-a206-5379b2ad700b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:14 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76f47bb-c107-432b-8bb3-05befdaa2742]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:25:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-1e5782be-9428-4bd2-be48-7a03a1d77cfe req-5d0e5c2e-abd2-4537-8929-f610e53c3d90 tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-58fb19d3-b425-4a45-a137-2937cbd4ce70 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:14 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Volume volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e (bff864b9-d81d-4152-8651-ca1b16aa9c0e): created successfully Jun 28 14:25:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6636f235-a613-4099-a206-5379b2ad700b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Flow 'volume_create_manager' (fc74a353-f33a-411b-a449-b06e80a7803f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:25:14 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7933db4e-4fc4-4663-9f06-e2f4201e0f6d tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Created volume successfully. Jun 28 14:25:14 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-58fb19d3-b425-4a45-a137-2937cbd4ce70 Jun 28 14:25:14 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-a793ea64-2626-402b-abb8-936d32cd7f87 req-ca06f138-cdbf-437e-b3ab-b69c46783024 tempest-AttachVolumeShelveTestJSON-733682715 None] No connector for attachment c0901690-4070-4b77-b8a6-7764a0ea9b32; skipping storage backend terminate_connection call. {{(pid=93561) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 28 14:25:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-a793ea64-2626-402b-abb8-936d32cd7f87 req-ca06f138-cdbf-437e-b3ab-b69c46783024 tempest-AttachVolumeShelveTestJSON-733682715 None] Deleting attachment c0901690-4070-4b77-b8a6-7764a0ea9b32. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:25:15 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-1e5782be-9428-4bd2-be48-7a03a1d77cfe req-5d0e5c2e-abd2-4537-8929-f610e53c3d90 tempest-AttachVolumeNegativeTest-1777782759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-58fb19d3-b425-4a45-a137-2937cbd4ce70" returned: 0 in 0.887s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-1e5782be-9428-4bd2-be48-7a03a1d77cfe req-5d0e5c2e-abd2-4537-8929-f610e53c3d90 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.919s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:25:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-1e5782be-9428-4bd2-be48-7a03a1d77cfe req-5d0e5c2e-abd2-4537-8929-f610e53c3d90 tempest-AttachVolumeNegativeTest-1777782759 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-58fb19d3-b425-4a45-a137-2937cbd4ce70', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '622594bb-fdf5-4dff-bc4b-55da1d1ce0d6', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:25:15 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-1e5782be-9428-4bd2-be48-7a03a1d77cfe req-5d0e5c2e-abd2-4537-8929-f610e53c3d90 tempest-AttachVolumeNegativeTest-1777782759 None] attachment_update completed successfully. Jun 28 14:25:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:25:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:25:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Creating offline snapshot ba5c2068-023c-4ad0-9de1-4c605a75c14b of volume bff864b9-d81d-4152-8651-ca1b16aa9c0e {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:25:16 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c05fa0-854c-4ba3-a496-777579f07892]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:25:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:16 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e Jun 28 14:25:16 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:17 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e" returned: 0 in 1.024s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:17 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b 1G Jun 28 14:25:17 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:18 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b 1G" returned: 0 in 1.202s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:18 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b Jun 28 14:25:18 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:19 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b" returned: 0 in 1.352s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:19 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b is being set with open permissions: ugo+rw Jun 28 14:25:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:19 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b Jun 28 14:25:19 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:21 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b" returned: 0 in 1.454s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:21 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.info Jun 28 14:25:21 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:22 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.info" returned: 0 in 1.334s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:22 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.info is being set with open permissions: ugo+rw Jun 28 14:25:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:22 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.info Jun 28 14:25:22 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:24 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.info" returned: 0 in 1.366s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.933s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:25:24 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-cf207687-2b49-4464-b29c-ef5da74426e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Create snapshot completed successfully Jun 28 14:25:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Acquiring lock "cinder-ba5c2068-023c-4ad0-9de1-4c605a75c14b-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:25:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "cinder-ba5c2068-023c-4ad0-9de1-4c605a75c14b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:25:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Acquiring lock "cinder-quobyte-bff864b9-d81d-4152-8651-ca1b16aa9c0e" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:25:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "cinder-quobyte-bff864b9-d81d-4152-8651-ca1b16aa9c0e" acquired by "delete_snapshot" :: waited 0.045s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:25:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Acquiring lock "cinder-quobyte-ba5c2068-023c-4ad0-9de1-4c605a75c14b" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:25:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "cinder-quobyte-ba5c2068-023c-4ad0-9de1-4c605a75c14b" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:25:25 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Deleting offline snapshot ba5c2068-023c-4ad0-9de1-4c605a75c14b of volume bff864b9-d81d-4152-8651-ca1b16aa9c0e {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:25:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] snapshot_file for this snap is: volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:25:26 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e209fa9a-71b1-4257-84af-b2a93cd7e067]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:25:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:26 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b Jun 28 14:25:26 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:27 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b" returned: 0 in 1.512s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:25:27 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe0f374-d4f4-41a6-9f80-ad71e98b1f00]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:25:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:28 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e Jun 28 14:25:28 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:29 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e" returned: 0 in 1.506s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:29 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b Jun 28 14:25:29 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:30 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b" returned: 0 in 1.775s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:31 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b Jun 28 14:25:31 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:32 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e.ba5c2068-023c-4ad0-9de1-4c605a75c14b" returned: 0 in 1.088s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "cinder-quobyte-ba5c2068-023c-4ad0-9de1-4c605a75c14b" released by "_delete_snapshot" :: held 6.210s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:25:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "cinder-quobyte-bff864b9-d81d-4152-8651-ca1b16aa9c0e" released by "delete_snapshot" :: held 6.282s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:25:32 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Created reservations ['813f2b74-3f27-46cc-9a32-55b9c86841e5', '57b025c2-02b0-4d5f-aa9a-594c9bf49ed8', 'c0663730-11c6-4680-bf26-4b165dcddbb9', 'd68929b7-12dd-44b9-91c9-cc95ed8cc038'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:25:32 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Delete snapshot completed successfully. Jun 28 14:25:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-051c3aff-ab52-455a-b87e-301a3fb9c3e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "cinder-ba5c2068-023c-4ad0-9de1-4c605a75c14b-delete_snapshot" released by "delete_snapshot" :: held 6.601s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:25:33 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Acquiring lock "cinder-bff864b9-d81d-4152-8651-ca1b16aa9c0e-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:25:33 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "cinder-bff864b9-d81d-4152-8651-ca1b16aa9c0e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:25:33 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Acquiring lock "cinder-quobyte-bff864b9-d81d-4152-8651-ca1b16aa9c0e" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:25:33 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "cinder-quobyte-bff864b9-d81d-4152-8651-ca1b16aa9c0e" acquired by "delete_volume" :: waited 0.034s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:25:33 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71c38d4-0733-4967-8a5f-da430fbd4acf]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:25:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:34 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e Jun 28 14:25:34 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:35 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e" returned: 0 in 1.327s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:35 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e Jun 28 14:25:35 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:36 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bff864b9-d81d-4152-8651-ca1b16aa9c0e" returned: 0 in 1.121s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "cinder-quobyte-bff864b9-d81d-4152-8651-ca1b16aa9c0e" released by "delete_volume" :: held 2.654s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:25:36 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Created reservations ['39ba129c-3c1b-4d98-aedf-3bfcc9bef513', '3b0e518b-4576-42e7-9c86-972ece324436', '199f0e0b-ebe0-47f1-aeed-ebc955e3241a', '39af843a-e448-46bc-a120-188969d13980'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:25:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:25:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:25:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:25:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:25:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:25:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:36 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:25:36 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:25:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:25:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:25:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:25:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:25:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:25:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:37 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:25:37 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:38 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.995s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:25:38 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Deleted volume successfully. Jun 28 14:25:38 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-34f5fcd5-ae00-4443-bdd0-50bd6af51a9f tempest-VolumeSnapshotQuotasNegativeTestJSON-263731607 None] Lock "cinder-bff864b9-d81d-4152-8651-ca1b16aa9c0e-delete_volume" released by "delete_volume" :: held 5.199s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:25:38 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.169s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:25:39 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:25:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 8 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:25:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Flow 'volume_create_manager' (25d4f9af-e6b7-4dbf-8a8f-9d7a6b2766f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a45c24f-a570-45e9-bd45-f9188f9675ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a45c24f-a570-45e9-bd45-f9188f9675ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2065704456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551e2e5d-a45b-4692-9ca9-9ae11e9cf061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c19be5d6234b5c93aa61c6817f4087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:25:41Z,use_quota=True,user_id='e21c132c9e2d41b8829195d77f88e75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21456a0b-ad0e-47fc-a021-2df3e96279bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21456a0b-ad0e-47fc-a021-2df3e96279bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcbac15-6869-462b-b73a-f28a35f14dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcbac15-6869-462b-b73a-f28a35f14dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '551e2e5d-a45b-4692-9ca9-9ae11e9cf061', 'volume_name': 'volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f08077-80b5-4773-9f96-5e0637b3a4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f08077-80b5-4773-9f96-5e0637b3a4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7fe515b-ec33-4a47-853e-61d02f0a5c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:40 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Volume 551e2e5d-a45b-4692-9ca9-9ae11e9cf061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061', 'volume_size': 1} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2065704456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551e2e5d-a45b-4692-9ca9-9ae11e9cf061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c19be5d6234b5c93aa61c6817f4087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:25:41Z,use_quota=True,user_id='e21c132c9e2d41b8829195d77f88e75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Creating volume 551e2e5d-a45b-4692-9ca9-9ae11e9cf061 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:25:40 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:25:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:40 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061 1073741824 Jun 28 14:25:40 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:41 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061 1073741824" returned: 0 in 1.106s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:25:41 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061 Jun 28 14:25:41 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:25:43 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Jun 28 14:25:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061" returned: 0 in 1.272s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:25:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] <== create_volume: return (2445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:25:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.447s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:25:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7fe515b-ec33-4a47-853e-61d02f0a5c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644655cf-bc22-4875-aa2c-67b9ac438f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:25:43 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Volume volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061 (551e2e5d-a45b-4692-9ca9-9ae11e9cf061): created successfully Jun 28 14:25:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644655cf-bc22-4875-aa2c-67b9ac438f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:25:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Flow 'volume_create_manager' (25d4f9af-e6b7-4dbf-8a8f-9d7a6b2766f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:25:43 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-fd988194-d126-4288-a45d-3577676ee019 tempest-ServerRescueNegativeTestJSON-588105104 None] Created volume successfully. Jun 28 14:25:53 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:UPDATE=46,cinder:SELECT=34,cinder:DELETE=3,cinder:INSERT=6 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:25:53 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=37,cinder:INSERT=12,cinder:UPDATE=33,cinder:DELETE=5 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:26:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Acquiring lock "cinder-551e2e5d-a45b-4692-9ca9-9ae11e9cf061-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:26:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Lock "cinder-551e2e5d-a45b-4692-9ca9-9ae11e9cf061-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:26:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Acquiring lock "cinder-quobyte-551e2e5d-a45b-4692-9ca9-9ae11e9cf061" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:26:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Lock "cinder-quobyte-551e2e5d-a45b-4692-9ca9-9ae11e9cf061" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:26:11 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[db70a2b5-6368-4a4a-9a95-04b44e34cc0b]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:26:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:11 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061 Jun 28 14:26:11 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:12 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061" returned: 0 in 0.865s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:12 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061 Jun 28 14:26:12 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:13 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-551e2e5d-a45b-4692-9ca9-9ae11e9cf061" returned: 0 in 0.806s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Lock "cinder-quobyte-551e2e5d-a45b-4692-9ca9-9ae11e9cf061" released by "delete_volume" :: held 1.737s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:26:13 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Created reservations ['ea43311e-938e-4464-98d4-2e29d976815a', 'c1d01462-f92e-49b2-b40f-7c033144818e', 'e9290a45-714b-4df4-9f11-bb2d19f5ad83', '17666f9f-cfed-4f29-8144-fce67a1f92a9'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:26:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:26:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:26:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:26:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:26:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:26:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:13 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:26:13 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:14 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.094s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:14 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:26:14 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Deleted volume successfully. Jun 28 14:26:14 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8a524403-322b-47ed-8d4e-4d9fa29ae5b7 tempest-ServerRescueNegativeTestJSON-588105104 None] Lock "cinder-551e2e5d-a45b-4692-9ca9-9ae11e9cf061-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:26:23 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:26:24 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=3,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:26:30 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-153604e8-7e64-4d63-a1c4-b708265b083c req-cde6f7c6-d8ec-4c94-9e08-bfbbd48a9e09 tempest-AttachVolumeNegativeTest-1777782759 None] Terminate volume connection completed successfully. Jun 28 14:26:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-153604e8-7e64-4d63-a1c4-b708265b083c req-cde6f7c6-d8ec-4c94-9e08-bfbbd48a9e09 tempest-AttachVolumeNegativeTest-1777782759 None] Deleting attachment 622594bb-fdf5-4dff-bc4b-55da1d1ce0d6. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:26:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Acquiring lock "cinder-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:26:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Lock "cinder-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:26:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Acquiring lock "cinder-quobyte-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:26:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Lock "cinder-quobyte-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc" acquired by "delete_volume" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:26:35 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c942c5-15b4-4131-8ac6-8bf8951a635f]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:26:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:35 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc Jun 28 14:26:35 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:36 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc" returned: 0 in 0.990s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:36 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc Jun 28 14:26:36 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:37 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc" returned: 0 in 0.851s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Lock "cinder-quobyte-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc" released by "delete_volume" :: held 1.887s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Created reservations ['ad45a46e-a39d-423e-b0fd-73471ddebeea', 'ba1d5516-4d21-4b45-8c07-0449ba76d074', '3cb7f1bb-3ac4-4b40-aa7f-2286fb2bfe8d', 'cd1d9e07-c582-4b0c-b814-2b0ac69a3e4d'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:37 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:26:37 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:26:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:37 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:26:37 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:38 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.050s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:26:38 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Deleted volume successfully. Jun 28 14:26:38 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f0b67626-992a-4c00-8f0e-1f1bff8b873c tempest-AttachVolumeShelveTestJSON-733682715 None] Lock "cinder-ad6eeeec-c3c7-4167-9393-d8e2c83b4dfc-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:26:38 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.859s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:26:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:26:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 8 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:26:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Flow 'volume_create_manager' (213deca2-f876-4629-994d-d69aa0dacc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47ce69c-4ff0-4b64-aada-11c441636ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47ce69c-4ff0-4b64-aada-11c441636ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-89223847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5216d8f7-3805-41be-b4a0-5ba7fa11da02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c86e0a1c32444a88a3b4eafe86cf12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:26:43Z,use_quota=True,user_id='1569bfdc692a4635913873688bad0fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fd1a1b-a588-418d-add8-00c8dfcd86dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fd1a1b-a588-418d-add8-00c8dfcd86dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844340c2-b1d0-47ec-b14c-33c9c283288c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844340c2-b1d0-47ec-b14c-33c9c283288c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5216d8f7-3805-41be-b4a0-5ba7fa11da02', 'volume_name': 'volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b5adea-2f42-4117-8a00-226c7ddb8175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b5adea-2f42-4117-8a00-226c7ddb8175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c398ba12-2ab1-4d85-a43b-076608f79431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:26:42 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Volume 5216d8f7-3805-41be-b4a0-5ba7fa11da02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02', 'volume_size': 1} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-89223847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5216d8f7-3805-41be-b4a0-5ba7fa11da02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c86e0a1c32444a88a3b4eafe86cf12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:26:43Z,use_quota=True,user_id='1569bfdc692a4635913873688bad0fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Creating volume 5216d8f7-3805-41be-b4a0-5ba7fa11da02 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:26:42 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:26:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:42 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 1073741824 Jun 28 14:26:42 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:44 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 1073741824" returned: 0 in 1.719s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:44 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 Jun 28 14:26:44 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Flow 'volume_create_manager' (4dd205c6-cea2-4644-a4dc-949418d4ff0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af84583-2d5d-4e18-a570-0e36623e4f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af84583-2d5d-4e18-a570-0e36623e4f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-523672901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b157db42-a551-4075-abfd-f0af1f93115f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c72fb54c5e4d6db561ac9d74200f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:26:46Z,use_quota=True,user_id='7fea989ff9ab46e2af920b4685923cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a8decf-9460-4344-81fd-e212d767321c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a8decf-9460-4344-81fd-e212d767321c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a3484f-c84c-44ef-9bf7-f60416beffa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a3484f-c84c-44ef-9bf7-f60416beffa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b157db42-a551-4075-abfd-f0af1f93115f', 'volume_name': 'volume-b157db42-a551-4075-abfd-f0af1f93115f', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a2992f-b363-4068-8ffe-e18f36cc30ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a2992f-b363-4068-8ffe-e18f36cc30ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2d4eeb-eaed-4cfb-a770-2b46237dfcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:26:45 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Volume b157db42-a551-4075-abfd-f0af1f93115f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b157db42-a551-4075-abfd-f0af1f93115f', 'volume_size': 1} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:26:45 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02" returned: 0 in 1.172s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] <== create_volume: return (2970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.974s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.086s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-523672901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b157db42-a551-4075-abfd-f0af1f93115f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c72fb54c5e4d6db561ac9d74200f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:26:46Z,use_quota=True,user_id='7fea989ff9ab46e2af920b4685923cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Creating volume b157db42-a551-4075-abfd-f0af1f93115f {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:26:45 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b157db42-a551-4075-abfd-f0af1f93115f 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:45 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b157db42-a551-4075-abfd-f0af1f93115f 1073741824 Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c398ba12-2ab1-4d85-a43b-076608f79431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:26:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a0d3c0-f707-4a6d-8bc4-b3a1c096f8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:26:45 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:46 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Volume volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 (5216d8f7-3805-41be-b4a0-5ba7fa11da02): created successfully Jun 28 14:26:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a0d3c0-f707-4a6d-8bc4-b3a1c096f8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:26:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Flow 'volume_create_manager' (213deca2-f876-4629-994d-d69aa0dacc9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:26:46 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-e46c4551-ff5a-4d51-8df1-2f1beaff337a req-1f35717d-e638-4024-ad63-b343fe5d95ed tempest-VolumesSnapshotsTestJSON-994374858 None] Created volume successfully. Jun 28 14:26:47 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b157db42-a551-4075-abfd-f0af1f93115f 1073741824" returned: 0 in 1.154s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b157db42-a551-4075-abfd-f0af1f93115f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:47 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b157db42-a551-4075-abfd-f0af1f93115f Jun 28 14:26:47 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:26:48 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b157db42-a551-4075-abfd-f0af1f93115f" returned: 0 in 1.279s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] <== create_volume: return (2490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:26:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.497s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:26:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.695s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:26:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] Creating offline snapshot 973ae4ca-1a6f-4583-b736-b498c47213e6 of volume 5216d8f7-3805-41be-b4a0-5ba7fa11da02 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:26:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2d4eeb-eaed-4cfb-a770-2b46237dfcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b157db42-a551-4075-abfd-f0af1f93115f', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:26:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788e17d9-11d1-4a23-a2b5-69d702a85255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:26:48 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f9b6f9-8b19-4978-a675-55aaab8b1fcd]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:26:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:48 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Volume volume-b157db42-a551-4075-abfd-f0af1f93115f (b157db42-a551-4075-abfd-f0af1f93115f): created successfully Jun 28 14:26:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788e17d9-11d1-4a23-a2b5-69d702a85255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:26:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Flow 'volume_create_manager' (4dd205c6-cea2-4644-a4dc-949418d4ff0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:26:48 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 Jun 28 14:26:48 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:48 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a6feba16-25a5-4143-ae50-154ca5620cad tempest-VolumesActionsTest-1276597425 None] Created volume successfully. Jun 28 14:26:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-045e0e94-488a-4ff4-bde1-0c06cc87d89f tempest-VolumesActionsTest-1276597425 None] Acquiring lock "cinder-b157db42-a551-4075-abfd-f0af1f93115f" by "attach_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:26:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-045e0e94-488a-4ff4-bde1-0c06cc87d89f tempest-VolumesActionsTest-1276597425 None] Lock "cinder-b157db42-a551-4075-abfd-f0af1f93115f" acquired by "attach_volume" :: waited 0.030s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:26:49 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-045e0e94-488a-4ff4-bde1-0c06cc87d89f tempest-VolumesActionsTest-1276597425 None] Attaching volume b157db42-a551-4075-abfd-f0af1f93115f to instance e5af4075-1792-47a7-a9a1-9865620729d5 at mountpoint /dev/vdb on host None. Jun 28 14:26:49 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-045e0e94-488a-4ff4-bde1-0c06cc87d89f tempest-VolumesActionsTest-1276597425 None] Attach volume completed successfully. Jun 28 14:26:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-045e0e94-488a-4ff4-bde1-0c06cc87d89f tempest-VolumesActionsTest-1276597425 None] Lock "cinder-b157db42-a551-4075-abfd-f0af1f93115f" released by "attach_volume" :: held 0.129s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:26:49 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02" returned: 0 in 0.945s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:49 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6 1G Jun 28 14:26:49 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:50 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e1b7f707-23d3-4db8-8dd9-d9efbc449ff1 tempest-VolumesActionsTest-1611292274 None] Terminate volume connection completed successfully. Jun 28 14:26:50 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6 1G" returned: 0 in 1.309s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:50 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6 Jun 28 14:26:50 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e1b7f707-23d3-4db8-8dd9-d9efbc449ff1 tempest-VolumesActionsTest-1611292274 None] Acquiring lock "cinder-b157db42-a551-4075-abfd-f0af1f93115f-detach_volume" by "detach_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:26:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e1b7f707-23d3-4db8-8dd9-d9efbc449ff1 tempest-VolumesActionsTest-1611292274 None] Lock "cinder-b157db42-a551-4075-abfd-f0af1f93115f-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:26:51 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e1b7f707-23d3-4db8-8dd9-d9efbc449ff1 tempest-VolumesActionsTest-1611292274 None] Detaching volume b157db42-a551-4075-abfd-f0af1f93115f from instance e5af4075-1792-47a7-a9a1-9865620729d5. Jun 28 14:26:51 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e1b7f707-23d3-4db8-8dd9-d9efbc449ff1 tempest-VolumesActionsTest-1611292274 None] Detach volume completed successfully. Jun 28 14:26:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e1b7f707-23d3-4db8-8dd9-d9efbc449ff1 tempest-VolumesActionsTest-1611292274 None] Lock "cinder-b157db42-a551-4075-abfd-f0af1f93115f-detach_volume" released by "detach_volume" :: held 0.160s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:26:51 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6" returned: 0 in 0.952s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:51 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6 is being set with open permissions: ugo+rw Jun 28 14:26:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:51 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6 Jun 28 14:26:51 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c87f1beb-c94a-4587-9a80-e001dd7ecccd tempest-VolumesActionsTest-1276597425 None] Acquiring lock "cinder-b157db42-a551-4075-abfd-f0af1f93115f-detach_volume" by "detach_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:26:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c87f1beb-c94a-4587-9a80-e001dd7ecccd tempest-VolumesActionsTest-1276597425 None] Lock "cinder-b157db42-a551-4075-abfd-f0af1f93115f-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:26:51 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c87f1beb-c94a-4587-9a80-e001dd7ecccd tempest-VolumesActionsTest-1276597425 None] Volume detach called, but volume not attached. Jun 28 14:26:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c87f1beb-c94a-4587-9a80-e001dd7ecccd tempest-VolumesActionsTest-1276597425 None] Lock "cinder-b157db42-a551-4075-abfd-f0af1f93115f-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:26:52 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6" returned: 0 in 0.950s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Acquiring lock "cinder-b157db42-a551-4075-abfd-f0af1f93115f-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:26:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:52 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.info Jun 28 14:26:52 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Lock "cinder-b157db42-a551-4075-abfd-f0af1f93115f-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:26:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Acquiring lock "cinder-quobyte-b157db42-a551-4075-abfd-f0af1f93115f" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:26:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Lock "cinder-quobyte-b157db42-a551-4075-abfd-f0af1f93115f" acquired by "delete_volume" :: waited 0.055s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:26:52 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c29dfd0-9bd0-47e7-ad45-bd8233330914]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:26:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b157db42-a551-4075-abfd-f0af1f93115f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:53 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b157db42-a551-4075-abfd-f0af1f93115f Jun 28 14:26:53 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:53 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.info" returned: 0 in 0.906s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:53 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.info is being set with open permissions: ugo+rw Jun 28 14:26:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:53 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.info Jun 28 14:26:53 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:54 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b157db42-a551-4075-abfd-f0af1f93115f" returned: 0 in 1.332s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b157db42-a551-4075-abfd-f0af1f93115f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:54 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b157db42-a551-4075-abfd-f0af1f93115f Jun 28 14:26:54 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:54 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.info" returned: 0 in 1.077s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.362s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:26:54 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-7c7a269a-08dd-47d3-8ea0-5fe54acf2f41 req-727a9be9-1d9c-439b-9396-8d99a736fec5 tempest-VolumesSnapshotsTestJSON-994374858 None] Create snapshot completed successfully Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Acquiring lock "cinder-973ae4ca-1a6f-4583-b736-b498c47213e6-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "cinder-973ae4ca-1a6f-4583-b736-b498c47213e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Acquiring lock "cinder-quobyte-5216d8f7-3805-41be-b4a0-5ba7fa11da02" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "cinder-quobyte-5216d8f7-3805-41be-b4a0-5ba7fa11da02" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Acquiring lock "cinder-quobyte-973ae4ca-1a6f-4583-b736-b498c47213e6" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "cinder-quobyte-973ae4ca-1a6f-4583-b736-b498c47213e6" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Deleting offline snapshot 973ae4ca-1a6f-4583-b736-b498c47213e6 of volume 5216d8f7-3805-41be-b4a0-5ba7fa11da02 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] snapshot_file for this snap is: volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[564c6a5f-9aea-4f67-b57e-01b391bcb57b]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:55 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6 Jun 28 14:26:55 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:55 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b157db42-a551-4075-abfd-f0af1f93115f" returned: 0 in 1.442s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Lock "cinder-quobyte-b157db42-a551-4075-abfd-f0af1f93115f" released by "delete_volume" :: held 2.840s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Created reservations ['7a901352-8238-4711-9e48-6a26149f1771', '9e477e17-a25d-4a9b-a1da-3cbb525a8e92', '36668c91-4613-4838-98c2-3053915e023e', '223735ae-c50e-43f4-bacb-3ba641c6a6f6'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:26:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:26:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:26:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:26:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:56 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:26:56 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:56 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6" returned: 0 in 1.198s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:26:56 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23ed2e4-90dd-4735-a468-4873e4bba72b]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:26:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:56 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 Jun 28 14:26:56 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:56 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.974s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:56 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:26:56 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Deleted volume successfully. Jun 28 14:26:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5cc5848a-d71a-4d94-9cb4-4fdc927b7a13 tempest-VolumesActionsTest-1276597425 None] Lock "cinder-b157db42-a551-4075-abfd-f0af1f93115f-delete_volume" released by "delete_volume" :: held 4.263s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:26:57 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02" returned: 0 in 1.241s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:57 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6 Jun 28 14:26:57 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:58 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6" returned: 0 in 0.841s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:26:58 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6 Jun 28 14:26:58 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:26:59 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Jun 28 14:26:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02.973ae4ca-1a6f-4583-b736-b498c47213e6" returned: 0 in 0.764s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:26:59 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "cinder-quobyte-973ae4ca-1a6f-4583-b736-b498c47213e6" released by "_delete_snapshot" :: held 4.285s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:26:59 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "cinder-quobyte-5216d8f7-3805-41be-b4a0-5ba7fa11da02" released by "delete_snapshot" :: held 4.333s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:26:59 devstack cinder-volume[93561]: DEBUG cinder.quota [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Created reservations ['d6c94360-3338-471e-a478-85281eb7237f', '3ad8440a-1c7d-437d-9be2-552239eb30ae', '2a2c4cf6-7579-44c3-a34c-1ef3c778ae16', '9e73c87c-a313-4be1-837f-e665c3bc53ab'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:26:59 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Delete snapshot completed successfully. Jun 28 14:26:59 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-3c42d9d3-c5e7-4405-b4bc-b430aad32ebd req-3a71888c-3a8f-45d4-b76c-7312d8cc03df tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "cinder-973ae4ca-1a6f-4583-b736-b498c47213e6-delete_snapshot" released by "delete_snapshot" :: held 4.639s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:27:00 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Acquiring lock "cinder-5216d8f7-3805-41be-b4a0-5ba7fa11da02-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:27:00 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "cinder-5216d8f7-3805-41be-b4a0-5ba7fa11da02-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:27:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Acquiring lock "cinder-quobyte-5216d8f7-3805-41be-b4a0-5ba7fa11da02" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:27:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "cinder-quobyte-5216d8f7-3805-41be-b4a0-5ba7fa11da02" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:27:01 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ee14fe-dee7-43d6-95ad-3ed6af203089]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:27:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:01 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 Jun 28 14:27:01 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:02 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02" returned: 0 in 1.143s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:02 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02 Jun 28 14:27:02 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:03 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5216d8f7-3805-41be-b4a0-5ba7fa11da02" returned: 0 in 0.747s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:03 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "cinder-quobyte-5216d8f7-3805-41be-b4a0-5ba7fa11da02" released by "delete_volume" :: held 2.001s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:27:03 devstack cinder-volume[93561]: DEBUG cinder.quota [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Created reservations ['8a04320d-e2bd-4af4-bbc3-9b10e0c61a71', '650d64d8-cf7e-4bc6-af23-cdd217500616', '2a80981b-6220-4e8c-8ea7-305d822b3de4', 'a3bdb058-1cb1-44e4-9968-0b773801cd21'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:27:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:03 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:27:03 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:04 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.135s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:04 devstack cinder-volume[93561]: DEBUG cinder.manager [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:27:04 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Deleted volume successfully. Jun 28 14:27:04 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-04b0db21-3a95-411e-9d12-baa6966cd987 req-35af286b-0ff5-481e-830f-06e5e6d91baf tempest-VolumesSnapshotsTestJSON-994374858 None] Lock "cinder-5216d8f7-3805-41be-b4a0-5ba7fa11da02-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Flow 'volume_create_manager' (5ce28063-173d-46cf-a46b-a9e170371326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef63974-ef29-4e56-be2a-05550fdd3d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef63974-ef29-4e56-be2a-05550fdd3d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1774071325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb56b5e-2530-4b5e-924a-94e5f733b0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c72fb54c5e4d6db561ac9d74200f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:07Z,use_quota=True,user_id='7fea989ff9ab46e2af920b4685923cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921d2434-0bef-4d0e-a949-d47e14383586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921d2434-0bef-4d0e-a949-d47e14383586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410872bd-99cb-41d6-9e40-c3dd27423c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410872bd-99cb-41d6-9e40-c3dd27423c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eb56b5e-2530-4b5e-924a-94e5f733b0e0', 'volume_name': 'volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c46cc4-1294-4d27-a7cf-5536d27bec46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c46cc4-1294-4d27-a7cf-5536d27bec46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7367800f-a2d6-411d-be84-8557ffd196da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:07 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Volume 0eb56b5e-2530-4b5e-924a-94e5f733b0e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0', 'volume_size': 1} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1774071325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb56b5e-2530-4b5e-924a-94e5f733b0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c72fb54c5e4d6db561ac9d74200f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:07Z,use_quota=True,user_id='7fea989ff9ab46e2af920b4685923cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Creating volume 0eb56b5e-2530-4b5e-924a-94e5f733b0e0 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:27:07 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:27:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:07 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0 1073741824 Jun 28 14:27:07 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:08 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0 1073741824" returned: 0 in 0.922s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:08 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0 Jun 28 14:27:08 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:08 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0" returned: 0 in 0.658s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:27:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7367800f-a2d6-411d-be84-8557ffd196da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f4bd51-b251-49ca-b23a-1ed088457634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:08 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Volume volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0 (0eb56b5e-2530-4b5e-924a-94e5f733b0e0): created successfully Jun 28 14:27:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f4bd51-b251-49ca-b23a-1ed088457634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Flow 'volume_create_manager' (5ce28063-173d-46cf-a46b-a9e170371326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:08 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-06fb992a-f683-4080-b5de-1f08826c1275 tempest-VolumesActionsTest-1276597425 None] Created volume successfully. Jun 28 14:27:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Acquiring lock "cinder-0eb56b5e-2530-4b5e-924a-94e5f733b0e0-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:27:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Lock "cinder-0eb56b5e-2530-4b5e-924a-94e5f733b0e0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:27:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Acquiring lock "cinder-quobyte-0eb56b5e-2530-4b5e-924a-94e5f733b0e0" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:27:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Lock "cinder-quobyte-0eb56b5e-2530-4b5e-924a-94e5f733b0e0" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:27:09 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[889645ff-15c0-45a9-8d02-8ddfd4edb66d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:27:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:09 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0 Jun 28 14:27:09 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:10 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0" returned: 0 in 1.173s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:10 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0 Jun 28 14:27:10 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:11 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0eb56b5e-2530-4b5e-924a-94e5f733b0e0" returned: 0 in 1.273s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Lock "cinder-quobyte-0eb56b5e-2530-4b5e-924a-94e5f733b0e0" released by "delete_volume" :: held 2.518s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:27:12 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Created reservations ['114d8adb-c960-4610-969a-4ce9f2b0e40e', 'b4c6c209-4242-4f00-9879-dab752d1e4e2', '55fbd65e-566f-4481-ab0e-65e71a03d2eb', '7c758be5-0bab-4464-b1ce-4e7dbe5972b6'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:27:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:12 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:27:12 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:13 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.489s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:13 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:27:13 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Deleted volume successfully. Jun 28 14:27:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-22424e7c-912b-45f4-8acf-f2f83436d3bd tempest-VolumesActionsTest-1611292274 None] Lock "cinder-0eb56b5e-2530-4b5e-924a-94e5f733b0e0-delete_volume" released by "delete_volume" :: held 4.494s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:27:13 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:27:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Flow 'volume_create_manager' (fcb3b28e-e799-4911-9d4e-3fdf6790abbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2239d8d3-d906-428e-ba7d-9ae040e35772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2239d8d3-d906-428e-ba7d-9ae040e35772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-637049599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c175fdc-7962-4d12-9702-d3979fe50483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c72fb54c5e4d6db561ac9d74200f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:14Z,use_quota=True,user_id='7fea989ff9ab46e2af920b4685923cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28cac9c-310f-4d4b-ab4d-f255d0289535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28cac9c-310f-4d4b-ab4d-f255d0289535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0eff4d-9de1-4e54-a523-46d06a20b342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0eff4d-9de1-4e54-a523-46d06a20b342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c175fdc-7962-4d12-9702-d3979fe50483', 'volume_name': 'volume-1c175fdc-7962-4d12-9702-d3979fe50483', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f237cfe9-8c46-4e95-bee2-5b46747e4a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f237cfe9-8c46-4e95-bee2-5b46747e4a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5094bc92-30c1-47bf-8fc9-a1a0d0e43a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:14 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Volume 1c175fdc-7962-4d12-9702-d3979fe50483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c175fdc-7962-4d12-9702-d3979fe50483', 'volume_size': 1} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-637049599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c175fdc-7962-4d12-9702-d3979fe50483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c72fb54c5e4d6db561ac9d74200f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:14Z,use_quota=True,user_id='7fea989ff9ab46e2af920b4685923cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Creating volume 1c175fdc-7962-4d12-9702-d3979fe50483 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:27:14 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:27:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1c175fdc-7962-4d12-9702-d3979fe50483 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:14 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1c175fdc-7962-4d12-9702-d3979fe50483 1073741824 Jun 28 14:27:14 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:15 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-d7ca11a8-2e78-4a1d-808f-939a87f659bc tempest-GroupsV320Test-932593853 None] Group tempest-GroupsV320Test-Group-290632254: creating Jun 28 14:27:15 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-d7ca11a8-2e78-4a1d-808f-939a87f659bc tempest-GroupsV320Test-932593853 None] Group tempest-GroupsV320Test-Group-290632254: created successfully Jun 28 14:27:15 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-d7ca11a8-2e78-4a1d-808f-939a87f659bc tempest-GroupsV320Test-932593853 None] Create group completed successfully. Jun 28 14:27:15 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1c175fdc-7962-4d12-9702-d3979fe50483 1073741824" returned: 0 in 1.567s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1c175fdc-7962-4d12-9702-d3979fe50483 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:15 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1c175fdc-7962-4d12-9702-d3979fe50483 Jun 28 14:27:15 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:16 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1c175fdc-7962-4d12-9702-d3979fe50483" returned: 0 in 0.670s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] <== create_volume: return (2285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:27:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.288s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5094bc92-30c1-47bf-8fc9-a1a0d0e43a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c175fdc-7962-4d12-9702-d3979fe50483', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d7d21e-fcd9-4852-a681-6f0f61a84c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:16 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Volume volume-1c175fdc-7962-4d12-9702-d3979fe50483 (1c175fdc-7962-4d12-9702-d3979fe50483): created successfully Jun 28 14:27:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d7d21e-fcd9-4852-a681-6f0f61a84c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Flow 'volume_create_manager' (fcb3b28e-e799-4911-9d4e-3fdf6790abbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:16 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e5fd3ca4-7dcd-4e84-ae68-1c983e4a148c tempest-VolumesActionsTest-1276597425 None] Created volume successfully. Jun 28 14:27:17 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-3d6d789e-e2f7-445c-b2ce-1031ebdbd76f tempest-GroupsV320Test-932593853 None] Created reservations ['6ecedb74-aab4-4352-8ddb-e7d39ef82655'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:27:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Acquiring lock "cinder-1c175fdc-7962-4d12-9702-d3979fe50483-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:27:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Lock "cinder-1c175fdc-7962-4d12-9702-d3979fe50483-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:27:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3d6d789e-e2f7-445c-b2ce-1031ebdbd76f tempest-GroupsV320Test-932593853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3d6d789e-e2f7-445c-b2ce-1031ebdbd76f tempest-GroupsV320Test-932593853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3d6d789e-e2f7-445c-b2ce-1031ebdbd76f tempest-GroupsV320Test-932593853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3d6d789e-e2f7-445c-b2ce-1031ebdbd76f tempest-GroupsV320Test-932593853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3d6d789e-e2f7-445c-b2ce-1031ebdbd76f tempest-GroupsV320Test-932593853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3d6d789e-e2f7-445c-b2ce-1031ebdbd76f tempest-GroupsV320Test-932593853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:17 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:27:17 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Acquiring lock "cinder-quobyte-1c175fdc-7962-4d12-9702-d3979fe50483" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:27:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Lock "cinder-quobyte-1c175fdc-7962-4d12-9702-d3979fe50483" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:27:17 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2632103-0462-443a-9948-82684feedb4e]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:27:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1c175fdc-7962-4d12-9702-d3979fe50483 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:17 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1c175fdc-7962-4d12-9702-d3979fe50483 Jun 28 14:27:17 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:17 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3d6d789e-e2f7-445c-b2ce-1031ebdbd76f tempest-GroupsV320Test-932593853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.732s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:17 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-3d6d789e-e2f7-445c-b2ce-1031ebdbd76f tempest-GroupsV320Test-932593853 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:27:17 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-3d6d789e-e2f7-445c-b2ce-1031ebdbd76f tempest-GroupsV320Test-932593853 None] Delete group completed successfully. Jun 28 14:27:18 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1c175fdc-7962-4d12-9702-d3979fe50483" returned: 0 in 0.900s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1c175fdc-7962-4d12-9702-d3979fe50483 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:18 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1c175fdc-7962-4d12-9702-d3979fe50483 Jun 28 14:27:18 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:18 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1c175fdc-7962-4d12-9702-d3979fe50483" returned: 0 in 0.687s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Lock "cinder-quobyte-1c175fdc-7962-4d12-9702-d3979fe50483" released by "delete_volume" :: held 1.641s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:27:18 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Created reservations ['c71b06e0-ec37-443f-bcbc-dcf242855f66', '9879718c-08a2-488e-b279-b52125cee2b3', 'f2a3d4b7-ac7f-4b7c-9ebf-aed6d9484b70', 'a404b0a0-5ef4-4e1a-8246-0200ff7d600a'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:27:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:19 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:19 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:19 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:27:19 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:20 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.174s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:27:20 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Deleted volume successfully. Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-327bf9df-fd9d-450d-8ac0-aeda5d90f400 tempest-VolumesActionsTest-1611292274 None] Lock "cinder-1c175fdc-7962-4d12-9702-d3979fe50483-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Flow 'volume_create_manager' (67d1bffd-8e2d-4f77-807a-ed323b365397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f78c070-af1d-4381-8286-2e7d5cbf4c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f78c070-af1d-4381-8286-2e7d5cbf4c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1256346934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1bfdafd-137f-4400-a37f-b4a560eb4eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c72fb54c5e4d6db561ac9d74200f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:20Z,use_quota=True,user_id='7fea989ff9ab46e2af920b4685923cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d623eaf-5947-4113-9d6f-84b9d44a3134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d623eaf-5947-4113-9d6f-84b9d44a3134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2caa12b0-44ef-406f-8ede-cfb106bcf62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2caa12b0-44ef-406f-8ede-cfb106bcf62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1bfdafd-137f-4400-a37f-b4a560eb4eaf', 'volume_name': 'volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b386b9-6354-440f-a8ae-2b193e55b4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b386b9-6354-440f-a8ae-2b193e55b4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2407e5a9-6f72-4bc6-95d0-13dd2a4e49b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:20 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Volume a1bfdafd-137f-4400-a37f-b4a560eb4eaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf', 'volume_size': 1} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1256346934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1bfdafd-137f-4400-a37f-b4a560eb4eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c72fb54c5e4d6db561ac9d74200f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:20Z,use_quota=True,user_id='7fea989ff9ab46e2af920b4685923cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Creating volume a1bfdafd-137f-4400-a37f-b4a560eb4eaf {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:27:20 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:27:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:20 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf 1073741824 Jun 28 14:27:20 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:21 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf 1073741824" returned: 0 in 1.411s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:22 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf Jun 28 14:27:22 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:23 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf" returned: 0 in 1.490s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] <== create_volume: return (2996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:27:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.004s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2407e5a9-6f72-4bc6-95d0-13dd2a4e49b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e56835-4af7-45e2-8b3a-685ecfc96bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:23 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Volume volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf (a1bfdafd-137f-4400-a37f-b4a560eb4eaf): created successfully Jun 28 14:27:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e56835-4af7-45e2-8b3a-685ecfc96bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Flow 'volume_create_manager' (67d1bffd-8e2d-4f77-807a-ed323b365397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:23 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-8f12087b-2321-45d8-841b-de1d4ec6a5e2 tempest-VolumesActionsTest-1276597425 None] Created volume successfully. Jun 28 14:27:24 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Acquiring lock "cinder-a1bfdafd-137f-4400-a37f-b4a560eb4eaf-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:27:24 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Lock "cinder-a1bfdafd-137f-4400-a37f-b4a560eb4eaf-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:27:24 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=57,cinder:UPDATE=70,cinder:DELETE=5,cinder:INSERT=12 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:27:24 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=62,cinder:UPDATE=69,cinder:INSERT=21,cinder:DELETE=6 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:27:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Acquiring lock "cinder-quobyte-a1bfdafd-137f-4400-a37f-b4a560eb4eaf" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:27:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Lock "cinder-quobyte-a1bfdafd-137f-4400-a37f-b4a560eb4eaf" acquired by "delete_volume" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:27:25 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf5be36-54a3-4c3a-8cd7-86346661c95b]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:27:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:25 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf Jun 28 14:27:25 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:26 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf" returned: 0 in 1.170s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:26 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf Jun 28 14:27:26 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:27 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1bfdafd-137f-4400-a37f-b4a560eb4eaf" returned: 0 in 1.049s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Lock "cinder-quobyte-a1bfdafd-137f-4400-a37f-b4a560eb4eaf" released by "delete_volume" :: held 2.281s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:27:27 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Created reservations ['ba26c1ab-4724-4a55-bc51-be75e7efcdc7', '54461f1d-a1fe-40f0-ba57-3cda546de69d', 'c736a3f6-c650-416c-b83d-2c58e2521237', 'e311ef70-9a28-4b3f-8f6a-4e8ac1e97e85'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:27:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:27 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:27:27 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:28 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.703s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:28 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:27:28 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Deleted volume successfully. Jun 28 14:27:28 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-39a01afa-4895-49db-b3c1-c4c058038fec tempest-VolumesActionsTest-1611292274 None] Lock "cinder-a1bfdafd-137f-4400-a37f-b4a560eb4eaf-delete_volume" released by "delete_volume" :: held 3.270s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:27:28 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:27:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Flow 'volume_create_manager' (bed5fd78-203d-44bd-9493-53d6c5245237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacb740e-f739-4e86-9471-7d90815dd145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacb740e-f739-4e86-9471-7d90815dd145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1322933407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c2ed63-9666-4f79-afd5-64df5ae80fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c72fb54c5e4d6db561ac9d74200f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:29Z,use_quota=True,user_id='7fea989ff9ab46e2af920b4685923cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542d9db0-893c-4be5-99e7-0d49095f31b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542d9db0-893c-4be5-99e7-0d49095f31b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d7aaa3-c36f-4263-903a-26b841d7c795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d7aaa3-c36f-4263-903a-26b841d7c795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c2ed63-9666-4f79-afd5-64df5ae80fb0', 'volume_name': 'volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c277ff4-a9c2-4836-8263-ed5facf38923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c277ff4-a9c2-4836-8263-ed5facf38923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824146dc-2f28-47b3-a6c6-e134f7a3a1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:28 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Volume a2c2ed63-9666-4f79-afd5-64df5ae80fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0', 'volume_size': 1} Jun 28 14:27:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1322933407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c2ed63-9666-4f79-afd5-64df5ae80fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c72fb54c5e4d6db561ac9d74200f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:29Z,use_quota=True,user_id='7fea989ff9ab46e2af920b4685923cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:27:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Creating volume a2c2ed63-9666-4f79-afd5-64df5ae80fb0 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:27:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:27:29 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:27:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:29 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0 1073741824 Jun 28 14:27:29 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:30 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0 1073741824" returned: 0 in 1.190s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:30 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0 Jun 28 14:27:30 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:31 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0" returned: 0 in 0.874s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:31 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] <== create_volume: return (2145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:27:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824146dc-2f28-47b3-a6c6-e134f7a3a1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98999166-1753-4b59-be84-f84439fbb03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:31 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Volume volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0 (a2c2ed63-9666-4f79-afd5-64df5ae80fb0): created successfully Jun 28 14:27:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98999166-1753-4b59-be84-f84439fbb03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Flow 'volume_create_manager' (bed5fd78-203d-44bd-9493-53d6c5245237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:31 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7aea8fe0-6f10-49ab-a399-38d746b6b527 tempest-VolumesActionsTest-1276597425 None] Created volume successfully. Jun 28 14:27:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Acquiring lock "cinder-a2c2ed63-9666-4f79-afd5-64df5ae80fb0-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:27:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Lock "cinder-a2c2ed63-9666-4f79-afd5-64df5ae80fb0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:27:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Acquiring lock "cinder-quobyte-a2c2ed63-9666-4f79-afd5-64df5ae80fb0" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:27:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Lock "cinder-quobyte-a2c2ed63-9666-4f79-afd5-64df5ae80fb0" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:27:32 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76f0dcd-11f1-480a-bd19-0f36029645f2]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:27:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:32 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0 Jun 28 14:27:32 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:33 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0" returned: 0 in 0.879s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:33 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0 Jun 28 14:27:33 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:34 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2c2ed63-9666-4f79-afd5-64df5ae80fb0" returned: 0 in 0.853s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:34 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Lock "cinder-quobyte-a2c2ed63-9666-4f79-afd5-64df5ae80fb0" released by "delete_volume" :: held 1.771s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:27:34 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Created reservations ['80f8a1d0-0d35-4f95-b46e-684ebcb98870', 'e5f316a0-162e-4d53-ab6f-b21179cf8801', '8ebe3b79-5ff1-44c3-b19a-12980e3e34ff', '40f6623a-8688-4f64-b47b-0ac31a9edb03'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:27:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:34 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:27:34 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:35 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.137s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:27:35 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Deleted volume successfully. Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Flow 'volume_create_manager' (0fbd035c-2938-4288-aa72-6ff9d3e0c400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec69470-9353-46bb-b006-f2309a874cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec69470-9353-46bb-b006-f2309a874cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-728341800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd895c57-a526-4dd7-b61f-123bc5852036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c72fb54c5e4d6db561ac9d74200f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:35Z,use_quota=True,user_id='7fea989ff9ab46e2af920b4685923cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65dc93d-b02e-4d09-ada5-ada1711e78d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65dc93d-b02e-4d09-ada5-ada1711e78d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4048943f-6147-4884-b4e2-d2467a089c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4048943f-6147-4884-b4e2-d2467a089c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd895c57-a526-4dd7-b61f-123bc5852036', 'volume_name': 'volume-bd895c57-a526-4dd7-b61f-123bc5852036', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8fd562-bd07-4866-b19a-cb653337c4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8fd562-bd07-4866-b19a-cb653337c4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37cf2a89-9b81-4b7f-b558-4510342388c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:35 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Volume bd895c57-a526-4dd7-b61f-123bc5852036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd895c57-a526-4dd7-b61f-123bc5852036', 'volume_size': 1} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-728341800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd895c57-a526-4dd7-b61f-123bc5852036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c72fb54c5e4d6db561ac9d74200f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:35Z,use_quota=True,user_id='7fea989ff9ab46e2af920b4685923cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Creating volume bd895c57-a526-4dd7-b61f-123bc5852036 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:27:35 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd895c57-a526-4dd7-b61f-123bc5852036 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5697375e-bc12-4fa0-9dc6-0e4d89a5d95c tempest-VolumesActionsTest-1611292274 None] Lock "cinder-a2c2ed63-9666-4f79-afd5-64df5ae80fb0-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:27:35 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd895c57-a526-4dd7-b61f-123bc5852036 1073741824 Jun 28 14:27:35 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:36 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:27:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Flow 'volume_create_manager' (aadceafb-17a7-4038-a1af-0a087c6b1583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e783f52-f8b4-4597-bcaa-20eb4a529805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e783f52-f8b4-4597-bcaa-20eb4a529805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1728380813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19b9ad0-88e9-4b61-86e6-da93e19b617e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53b03d920b944498c5123d7442675b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:36Z,use_quota=True,user_id='d012956dda804bae870abbb79898d029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23968281-255f-4bfe-9903-be4c4cedfc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23968281-255f-4bfe-9903-be4c4cedfc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62dfb329-d7d2-46e3-a783-f9c0dfc35a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62dfb329-d7d2-46e3-a783-f9c0dfc35a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c19b9ad0-88e9-4b61-86e6-da93e19b617e', 'volume_name': 'volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7781b8-1939-42b1-a73c-4bd75c1e11f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7781b8-1939-42b1-a73c-4bd75c1e11f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304ae1e0-fde8-4284-9e63-860425fba82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:36 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Volume c19b9ad0-88e9-4b61-86e6-da93e19b617e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e', 'volume_size': 1} Jun 28 14:27:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:36 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd895c57-a526-4dd7-b61f-123bc5852036 1073741824" returned: 0 in 1.236s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd895c57-a526-4dd7-b61f-123bc5852036 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:36 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd895c57-a526-4dd7-b61f-123bc5852036 Jun 28 14:27:36 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:37 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd895c57-a526-4dd7-b61f-123bc5852036" returned: 0 in 0.661s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.375s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1728380813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19b9ad0-88e9-4b61-86e6-da93e19b617e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53b03d920b944498c5123d7442675b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:36Z,use_quota=True,user_id='d012956dda804bae870abbb79898d029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Creating volume c19b9ad0-88e9-4b61-86e6-da93e19b617e {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:27:37 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:37 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e 1073741824 Jun 28 14:27:37 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37cf2a89-9b81-4b7f-b558-4510342388c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd895c57-a526-4dd7-b61f-123bc5852036', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3d59f8-3d82-47ee-8f2e-c949531fc4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:37 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Volume volume-bd895c57-a526-4dd7-b61f-123bc5852036 (bd895c57-a526-4dd7-b61f-123bc5852036): created successfully Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3d59f8-3d82-47ee-8f2e-c949531fc4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Flow 'volume_create_manager' (0fbd035c-2938-4288-aa72-6ff9d3e0c400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:37 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ae835b9b-4187-4b3d-88ce-eb766c618645 tempest-VolumesActionsTest-1276597425 None] Created volume successfully. Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:37 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:27:37 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:38 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e 1073741824" returned: 0 in 0.889s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:38 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.713s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:27:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:27:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 8 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:27:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:27:38 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e Jun 28 14:27:38 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:39 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e" returned: 0 in 0.692s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304ae1e0-fde8-4284-9e63-860425fba82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1034c0c0-8a10-447c-b431-76ee41e8cc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Acquiring lock "cinder-bd895c57-a526-4dd7-b61f-123bc5852036-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:27:39 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Volume volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e (c19b9ad0-88e9-4b61-86e6-da93e19b617e): created successfully Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1034c0c0-8a10-447c-b431-76ee41e8cc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Flow 'volume_create_manager' (aadceafb-17a7-4038-a1af-0a087c6b1583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Lock "cinder-bd895c57-a526-4dd7-b61f-123bc5852036-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Flow 'volume_create_manager' (56be2bdc-98fd-4dd1-9111-f6f96032d18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99578a94-9a18-4fee-896a-b1123cca3b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:39 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-47a4ae3c-6f06-4225-86ec-8f88ee181a29 tempest-AttachVolumeNegativeTest-1777782759 None] Created volume successfully. Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99578a94-9a18-4fee-896a-b1123cca3b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-558102473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bd6a38-e899-480a-8261-322381e852bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a17e778e8c74d89827b0fcddbe5d2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:39Z,use_quota=True,user_id='dee76e3c6143401488e6585b506cf4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e543743a-49de-4a47-a495-0d702139a70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e543743a-49de-4a47-a495-0d702139a70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a5874e-392b-41dc-8220-7212af3de6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a5874e-392b-41dc-8220-7212af3de6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32bd6a38-e899-480a-8261-322381e852bb', 'volume_name': 'volume-32bd6a38-e899-480a-8261-322381e852bb', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bcca2c-5f71-4b8c-82c1-489b22bcb2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bcca2c-5f71-4b8c-82c1-489b22bcb2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b5a45f-7965-46bf-b690-f8df87ba5e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:39 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Volume 32bd6a38-e899-480a-8261-322381e852bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32bd6a38-e899-480a-8261-322381e852bb', 'volume_size': 1} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-558102473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bd6a38-e899-480a-8261-322381e852bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a17e778e8c74d89827b0fcddbe5d2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:39Z,use_quota=True,user_id='dee76e3c6143401488e6585b506cf4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Creating volume 32bd6a38-e899-480a-8261-322381e852bb {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:27:39 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-32bd6a38-e899-480a-8261-322381e852bb 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:39 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-32bd6a38-e899-480a-8261-322381e852bb 1073741824 Jun 28 14:27:39 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Acquiring lock "cinder-quobyte-bd895c57-a526-4dd7-b61f-123bc5852036" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Lock "cinder-quobyte-bd895c57-a526-4dd7-b61f-123bc5852036" acquired by "delete_volume" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed7421d-c77b-42e4-8321-d4c94878d70a]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:27:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd895c57-a526-4dd7-b61f-123bc5852036 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:39 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd895c57-a526-4dd7-b61f-123bc5852036 Jun 28 14:27:39 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:40 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd895c57-a526-4dd7-b61f-123bc5852036" returned: 0 in 0.810s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd895c57-a526-4dd7-b61f-123bc5852036 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:40 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-32bd6a38-e899-480a-8261-322381e852bb 1073741824" returned: 0 in 0.923s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:40 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd895c57-a526-4dd7-b61f-123bc5852036 Jun 28 14:27:40 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-32bd6a38-e899-480a-8261-322381e852bb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:40 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-32bd6a38-e899-480a-8261-322381e852bb Jun 28 14:27:40 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:41 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd895c57-a526-4dd7-b61f-123bc5852036" returned: 0 in 0.666s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Lock "cinder-quobyte-bd895c57-a526-4dd7-b61f-123bc5852036" released by "delete_volume" :: held 1.525s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:27:41 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-32bd6a38-e899-480a-8261-322381e852bb" returned: 0 in 0.672s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Created reservations ['50bf389b-a932-4e1b-a6d7-53530b8f6760', 'b7678123-579e-4b37-878c-c82e7b06d4ff', '991a5818-de2c-4485-96d0-0000eaf724d8', '7eb702e9-3251-43e6-b68f-ffa66ea589e1'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b5a45f-7965-46bf-b690-f8df87ba5e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32bd6a38-e899-480a-8261-322381e852bb', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe2202e-0e01-4d4c-9bbe-582b91d9a0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:41 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Volume volume-32bd6a38-e899-480a-8261-322381e852bb (32bd6a38-e899-480a-8261-322381e852bb): created successfully Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe2202e-0e01-4d4c-9bbe-582b91d9a0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Flow 'volume_create_manager' (56be2bdc-98fd-4dd1-9111-f6f96032d18c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:41 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-aa4dcdab-0ef1-429c-a267-a5a017af68bd tempest-VolumesServicesTestJSON-1186702057 None] Created volume successfully. Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:41 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:27:41 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Acquiring lock "cinder-32bd6a38-e899-480a-8261-322381e852bb-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Lock "cinder-32bd6a38-e899-480a-8261-322381e852bb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Acquiring lock "cinder-quobyte-32bd6a38-e899-480a-8261-322381e852bb" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Lock "cinder-quobyte-32bd6a38-e899-480a-8261-322381e852bb" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[138fc643-7d60-4e8d-9c72-c693bad6180f]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-32bd6a38-e899-480a-8261-322381e852bb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:41 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-32bd6a38-e899-480a-8261-322381e852bb Jun 28 14:27:41 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:41 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.684s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:27:41 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Deleted volume successfully. Jun 28 14:27:41 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-df82f78e-e1ce-4077-afe5-324816b730c3 tempest-VolumesActionsTest-1276597425 None] Lock "cinder-bd895c57-a526-4dd7-b61f-123bc5852036-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:27:42 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-32bd6a38-e899-480a-8261-322381e852bb" returned: 0 in 0.848s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-32bd6a38-e899-480a-8261-322381e852bb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:42 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-32bd6a38-e899-480a-8261-322381e852bb Jun 28 14:27:42 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:43 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-32bd6a38-e899-480a-8261-322381e852bb" returned: 0 in 0.799s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Lock "cinder-quobyte-32bd6a38-e899-480a-8261-322381e852bb" released by "delete_volume" :: held 1.713s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:27:43 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Created reservations ['87ca6e92-df8b-4155-993b-1491c6064928', 'dd9a7b19-cd77-44b6-a48a-3ff70afa8b22', '7d1ddcda-da0c-4443-b9c7-9831c0c4287f', 'f613cc61-cff7-44c2-a63d-b13d312be6c6'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:27:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:43 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:27:43 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-9b86112a-03bd-41c8-a3f2-278f405d5df1 req-d3614d0b-498a-44ac-bc24-0734296af3f2 tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-9b86112a-03bd-41c8-a3f2-278f405d5df1 req-d3614d0b-498a-44ac-bc24-0734296af3f2 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:43 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b0021b-6562-4dad-9277-42cffc656e3f]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:27:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-9b86112a-03bd-41c8-a3f2-278f405d5df1 req-d3614d0b-498a-44ac-bc24-0734296af3f2 tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:43 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e Jun 28 14:27:43 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:44 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.886s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:44 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:27:44 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Deleted volume successfully. Jun 28 14:27:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-95035bb2-799b-4e91-b6e7-c1aabbaa80e7 tempest-VolumesServicesTestJSON-1186702057 None] Lock "cinder-32bd6a38-e899-480a-8261-322381e852bb-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:27:44 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-9b86112a-03bd-41c8-a3f2-278f405d5df1 req-d3614d0b-498a-44ac-bc24-0734296af3f2 tempest-AttachVolumeNegativeTest-1777782759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e" returned: 0 in 1.084s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-9b86112a-03bd-41c8-a3f2-278f405d5df1 req-d3614d0b-498a-44ac-bc24-0734296af3f2 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.106s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-9b86112a-03bd-41c8-a3f2-278f405d5df1 req-d3614d0b-498a-44ac-bc24-0734296af3f2 tempest-AttachVolumeNegativeTest-1777782759 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d067734-90ff-415e-afdf-6847f0185896', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:27:44 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-9b86112a-03bd-41c8-a3f2-278f405d5df1 req-d3614d0b-498a-44ac-bc24-0734296af3f2 tempest-AttachVolumeNegativeTest-1777782759 None] attachment_update completed successfully. Jun 28 14:27:47 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:27:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Flow 'volume_create_manager' (85d13547-427a-4334-8625-67e55ce2c588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09be749-49a1-40ac-b7d9-21f67cb7baff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09be749-49a1-40ac-b7d9-21f67cb7baff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-753229543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d0966e3-31b6-455e-babd-dd6fa2f8664a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455d5d9e4e7d4efab897b16308f78d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:48Z,use_quota=True,user_id='9dea6156f9914e80bc2a50a6c01055b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ce7017-df33-4cde-8722-bc557e1a4b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ce7017-df33-4cde-8722-bc557e1a4b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5dc2ff-6f3d-47a6-8822-3a46bcfa88b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5dc2ff-6f3d-47a6-8822-3a46bcfa88b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d0966e3-31b6-455e-babd-dd6fa2f8664a', 'volume_name': 'volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b52def-d05b-454e-bcb1-fe50cf3a204b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b52def-d05b-454e-bcb1-fe50cf3a204b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6cb7d5-b5e6-475e-ad7b-4857df87c237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:48 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Volume 6d0966e3-31b6-455e-babd-dd6fa2f8664a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a', 'volume_size': 1} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-753229543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d0966e3-31b6-455e-babd-dd6fa2f8664a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455d5d9e4e7d4efab897b16308f78d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:48Z,use_quota=True,user_id='9dea6156f9914e80bc2a50a6c01055b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Creating volume 6d0966e3-31b6-455e-babd-dd6fa2f8664a {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:27:48 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:27:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:48 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a 1073741824 Jun 28 14:27:48 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:49 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a 1073741824" returned: 0 in 1.059s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:49 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a Jun 28 14:27:49 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:50 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a" returned: 0 in 0.878s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:27:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6cb7d5-b5e6-475e-ad7b-4857df87c237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df73cff-cb13-48f7-8b9c-086614d2d794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:50 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Volume volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a (6d0966e3-31b6-455e-babd-dd6fa2f8664a): created successfully Jun 28 14:27:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df73cff-cb13-48f7-8b9c-086614d2d794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Flow 'volume_create_manager' (85d13547-427a-4334-8625-67e55ce2c588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:50 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-18df4714-6a78-4143-93e2-f8cb82def26a tempest-AttachVolumeTestJSON-144543565 None] Created volume successfully. Jun 28 14:27:51 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-fc819f47-c902-4209-9dc3-0d1765cff85f req-fe7fa60a-dacc-410b-be0e-e4e922c9f9ab tempest-AttachVolumeNegativeTest-1777782759 None] Terminate volume connection completed successfully. Jun 28 14:27:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-fc819f47-c902-4209-9dc3-0d1765cff85f req-fe7fa60a-dacc-410b-be0e-e4e922c9f9ab tempest-AttachVolumeNegativeTest-1777782759 None] Deleting attachment 7d067734-90ff-415e-afdf-6847f0185896. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:27:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-263b98bf-514f-41d8-b202-390e6dcd6cb0 req-7793ea11-ca8e-413f-8eeb-cc0aa34d2d58 tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-263b98bf-514f-41d8-b202-390e6dcd6cb0 req-7793ea11-ca8e-413f-8eeb-cc0aa34d2d58 tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:54 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[96814781-8770-4015-abaf-e2e3d92c4f09]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:27:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-263b98bf-514f-41d8-b202-390e6dcd6cb0 req-7793ea11-ca8e-413f-8eeb-cc0aa34d2d58 tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:54 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a Jun 28 14:27:54 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:55 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-263b98bf-514f-41d8-b202-390e6dcd6cb0 req-7793ea11-ca8e-413f-8eeb-cc0aa34d2d58 tempest-AttachVolumeTestJSON-144543565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a" returned: 0 in 1.450s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-263b98bf-514f-41d8-b202-390e6dcd6cb0 req-7793ea11-ca8e-413f-8eeb-cc0aa34d2d58 tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.481s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-263b98bf-514f-41d8-b202-390e6dcd6cb0 req-7793ea11-ca8e-413f-8eeb-cc0aa34d2d58 tempest-AttachVolumeTestJSON-144543565 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04442b61-368d-4943-82e4-61fab6a8e856', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:27:56 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-263b98bf-514f-41d8-b202-390e6dcd6cb0 req-7793ea11-ca8e-413f-8eeb-cc0aa34d2d58 tempest-AttachVolumeTestJSON-144543565 None] attachment_update completed successfully. Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Flow 'volume_create_manager' (a037d18a-b4c9-420c-b045-e225d1fdc39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a612ff-bdde-4ce7-81c4-b651f111d1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a612ff-bdde-4ce7-81c4-b651f111d1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1105068525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0cab69-2869-4cd9-a647-2ab447014072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd3c01e13a4cffad46375313d10ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:58Z,use_quota=True,user_id='73a22f4ec7344311868a1de0066af7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d1887e-d93e-4956-8c3a-c7579fc1ca65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d1887e-d93e-4956-8c3a-c7579fc1ca65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa1f80d-f6f0-439f-8f06-28108ceb7ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa1f80d-f6f0-439f-8f06-28108ceb7ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a0cab69-2869-4cd9-a647-2ab447014072', 'volume_name': 'volume-6a0cab69-2869-4cd9-a647-2ab447014072', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecc90bc-34ca-422d-868b-f263469ba6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecc90bc-34ca-422d-868b-f263469ba6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0525167-5138-4ee8-9c06-2855ec9de339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:57 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Volume 6a0cab69-2869-4cd9-a647-2ab447014072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a0cab69-2869-4cd9-a647-2ab447014072', 'volume_size': 1} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1105068525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0cab69-2869-4cd9-a647-2ab447014072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd3c01e13a4cffad46375313d10ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:27:58Z,use_quota=True,user_id='73a22f4ec7344311868a1de0066af7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Creating volume 6a0cab69-2869-4cd9-a647-2ab447014072 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:27:57 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:27:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6a0cab69-2869-4cd9-a647-2ab447014072 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:57 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6a0cab69-2869-4cd9-a647-2ab447014072 1073741824 Jun 28 14:27:57 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:58 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6a0cab69-2869-4cd9-a647-2ab447014072 1073741824" returned: 0 in 1.028s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6a0cab69-2869-4cd9-a647-2ab447014072 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:27:58 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6a0cab69-2869-4cd9-a647-2ab447014072 Jun 28 14:27:58 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:27:59 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Jun 28 14:27:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6a0cab69-2869-4cd9-a647-2ab447014072" returned: 0 in 0.691s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:27:59 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:27:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:27:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0525167-5138-4ee8-9c06-2855ec9de339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a0cab69-2869-4cd9-a647-2ab447014072', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d715a051-0a3d-44bd-8d7d-3657f67b4326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:27:59 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Volume volume-6a0cab69-2869-4cd9-a647-2ab447014072 (6a0cab69-2869-4cd9-a647-2ab447014072): created successfully Jun 28 14:27:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d715a051-0a3d-44bd-8d7d-3657f67b4326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:27:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Flow 'volume_create_manager' (a037d18a-b4c9-420c-b045-e225d1fdc39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:27:59 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-baafb1b4-1a59-44ea-b47d-57d33e4ff9a4 tempest-VolumesListAdminTestJSON-279869078 None] Created volume successfully. Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Flow 'volume_create_manager' (bb80fc2d-5a0d-4ef7-add7-3c56dc0308e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8249a62c-3135-49dc-a61b-b580cd1716d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8249a62c-3135-49dc-a61b-b580cd1716d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2063085145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921333c4-0ca1-41d2-909d-2f079acc9d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd3c01e13a4cffad46375313d10ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:28:01Z,use_quota=True,user_id='73a22f4ec7344311868a1de0066af7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d35272a-6f2d-45fe-a556-32e04f851523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d35272a-6f2d-45fe-a556-32e04f851523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28c316a-0bc9-4cfa-9e14-c5d4fc3ad836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28c316a-0bc9-4cfa-9e14-c5d4fc3ad836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '921333c4-0ca1-41d2-909d-2f079acc9d1f', 'volume_name': 'volume-921333c4-0ca1-41d2-909d-2f079acc9d1f', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc1d168-20a2-4773-a5c7-20dd32cb62f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc1d168-20a2-4773-a5c7-20dd32cb62f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d014a8-f1da-4a71-9fc2-96fa90ca4a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:01 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Volume 921333c4-0ca1-41d2-909d-2f079acc9d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-921333c4-0ca1-41d2-909d-2f079acc9d1f', 'volume_size': 1} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2063085145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921333c4-0ca1-41d2-909d-2f079acc9d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd3c01e13a4cffad46375313d10ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:28:01Z,use_quota=True,user_id='73a22f4ec7344311868a1de0066af7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Creating volume 921333c4-0ca1-41d2-909d-2f079acc9d1f {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:28:01 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:28:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-921333c4-0ca1-41d2-909d-2f079acc9d1f 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:01 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-921333c4-0ca1-41d2-909d-2f079acc9d1f 1073741824 Jun 28 14:28:01 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:02 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-921333c4-0ca1-41d2-909d-2f079acc9d1f 1073741824" returned: 0 in 0.978s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-921333c4-0ca1-41d2-909d-2f079acc9d1f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:02 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-921333c4-0ca1-41d2-909d-2f079acc9d1f Jun 28 14:28:02 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:03 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-921333c4-0ca1-41d2-909d-2f079acc9d1f" returned: 0 in 0.827s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:28:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d014a8-f1da-4a71-9fc2-96fa90ca4a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-921333c4-0ca1-41d2-909d-2f079acc9d1f', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca04cce-62ce-4402-91d3-7d29eca054b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:03 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Volume volume-921333c4-0ca1-41d2-909d-2f079acc9d1f (921333c4-0ca1-41d2-909d-2f079acc9d1f): created successfully Jun 28 14:28:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca04cce-62ce-4402-91d3-7d29eca054b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Flow 'volume_create_manager' (bb80fc2d-5a0d-4ef7-add7-3c56dc0308e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:28:03 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-d275b0bf-afbb-4708-a884-2a2452a809e6 tempest-VolumesListAdminTestJSON-279869078 None] Created volume successfully. Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Flow 'volume_create_manager' (8553f128-eb8c-4051-ba8b-b6b82c22776a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9c657f-71d0-4109-93da-42d30fe70939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9c657f-71d0-4109-93da-42d30fe70939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1364562821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e297e202-490b-42b0-b560-5efbc13a1885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd3c01e13a4cffad46375313d10ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:28:05Z,use_quota=True,user_id='73a22f4ec7344311868a1de0066af7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beea67e9-5fd9-4b40-87e0-5ddb0205b71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beea67e9-5fd9-4b40-87e0-5ddb0205b71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0da607-65fb-4ad1-ab79-4e5697ba6dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0da607-65fb-4ad1-ab79-4e5697ba6dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e297e202-490b-42b0-b560-5efbc13a1885', 'volume_name': 'volume-e297e202-490b-42b0-b560-5efbc13a1885', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c65fc31-26fb-45ac-b552-bdd09aca1bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c65fc31-26fb-45ac-b552-bdd09aca1bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36c08d0-98ca-4b60-9e28-31bcad4300a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:05 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Volume e297e202-490b-42b0-b560-5efbc13a1885: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e297e202-490b-42b0-b560-5efbc13a1885', 'volume_size': 1} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1364562821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e297e202-490b-42b0-b560-5efbc13a1885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd3c01e13a4cffad46375313d10ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:28:05Z,use_quota=True,user_id='73a22f4ec7344311868a1de0066af7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Creating volume e297e202-490b-42b0-b560-5efbc13a1885 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:28:05 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:28:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e297e202-490b-42b0-b560-5efbc13a1885 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:05 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e297e202-490b-42b0-b560-5efbc13a1885 1073741824 Jun 28 14:28:05 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:06 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e297e202-490b-42b0-b560-5efbc13a1885 1073741824" returned: 0 in 1.063s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e297e202-490b-42b0-b560-5efbc13a1885 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:06 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e297e202-490b-42b0-b560-5efbc13a1885 Jun 28 14:28:06 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:07 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e297e202-490b-42b0-b560-5efbc13a1885" returned: 0 in 0.862s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] <== create_volume: return (1982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:28:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.985s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36c08d0-98ca-4b60-9e28-31bcad4300a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e297e202-490b-42b0-b560-5efbc13a1885', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2ff82e-eaec-48ed-bd9e-64d97cd2aaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:07 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Volume volume-e297e202-490b-42b0-b560-5efbc13a1885 (e297e202-490b-42b0-b560-5efbc13a1885): created successfully Jun 28 14:28:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2ff82e-eaec-48ed-bd9e-64d97cd2aaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Flow 'volume_create_manager' (8553f128-eb8c-4051-ba8b-b6b82c22776a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:28:07 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-48636c03-41d1-4dae-8540-2f3f03c2d755 tempest-VolumesListAdminTestJSON-279869078 None] Created volume successfully. Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Flow 'volume_create_manager' (e8990ef8-290d-4552-9410-1c94e36fa210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a082ba-ba1a-4807-926d-fe6310acb721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a082ba-ba1a-4807-926d-fe6310acb721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b744bea38a4c4b6fbb56c3a86932ae81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:28:09Z,use_quota=True,user_id='06ae9e1d3d1e49fbb1e253cf578e96fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5971d984-6ea2-4c0a-89c5-ce22f111fd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5971d984-6ea2-4c0a-89c5-ce22f111fd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8426b25-8408-4f21-bfc2-bc0e99c28890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8426b25-8408-4f21-bfc2-bc0e99c28890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71', 'volume_name': 'volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1600c6c9-5907-435c-a297-c482b4b677a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1600c6c9-5907-435c-a297-c482b4b677a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cccc3da6-cbe8-4fb9-8715-f89920d097a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:09 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Volume 9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71', 'volume_size': 1} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b744bea38a4c4b6fbb56c3a86932ae81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:28:09Z,use_quota=True,user_id='06ae9e1d3d1e49fbb1e253cf578e96fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Creating volume 9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:28:09 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:28:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:09 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71 1073741824 Jun 28 14:28:09 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:10 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71 1073741824" returned: 0 in 0.894s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:10 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71 Jun 28 14:28:10 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:11 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71" returned: 0 in 0.704s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cccc3da6-cbe8-4fb9-8715-f89920d097a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d9f7d3-13d6-4316-8604-1fe129bc490f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:11 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Volume volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71 (9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71): created successfully Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d9f7d3-13d6-4316-8604-1fe129bc490f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Flow 'volume_create_manager' (e8990ef8-290d-4552-9410-1c94e36fa210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:28:11 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ab20f604-5bc2-4c92-9601-64a01859c699 tempest-VolumesListAdminTestJSON-570101872 None] Created volume successfully. Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Flow 'volume_create_manager' (690e50d6-e914-4557-9d5c-6919695f00a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea1b807-33b8-4296-b88f-ecad8e8434b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea1b807-33b8-4296-b88f-ecad8e8434b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-229613533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132baf80-a57b-4821-a589-c970d7c79655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b25d6d84294a00bc3778315525aa28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:28:11Z,use_quota=True,user_id='352ad16a43d641efb095a62ee88618f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda76314-8287-4af2-b40d-c04687d8d540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda76314-8287-4af2-b40d-c04687d8d540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891d7835-0e75-4626-b4bd-c8c23a12f08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891d7835-0e75-4626-b4bd-c8c23a12f08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132baf80-a57b-4821-a589-c970d7c79655', 'volume_name': 'volume-132baf80-a57b-4821-a589-c970d7c79655', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a0a42c-3c97-4ccd-8702-cb7e0f5c8d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a0a42c-3c97-4ccd-8702-cb7e0f5c8d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381d9d33-fcba-4831-ada1-d87499516361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:11 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Volume 132baf80-a57b-4821-a589-c970d7c79655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132baf80-a57b-4821-a589-c970d7c79655', 'volume_size': 1} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-229613533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132baf80-a57b-4821-a589-c970d7c79655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b25d6d84294a00bc3778315525aa28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:28:11Z,use_quota=True,user_id='352ad16a43d641efb095a62ee88618f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Creating volume 132baf80-a57b-4821-a589-c970d7c79655 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:28:11 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-132baf80-a57b-4821-a589-c970d7c79655 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:11 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-132baf80-a57b-4821-a589-c970d7c79655 1073741824 Jun 28 14:28:11 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Acquiring lock "cinder-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Lock "cinder-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Acquiring lock "cinder-quobyte-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Lock "cinder-quobyte-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b501d1c2-d042-491d-b96a-c3293a776a1e]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Acquiring lock "cinder-e297e202-490b-42b0-b560-5efbc13a1885-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Lock "cinder-e297e202-490b-42b0-b560-5efbc13a1885-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Acquiring lock "cinder-quobyte-e297e202-490b-42b0-b560-5efbc13a1885" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Lock "cinder-quobyte-e297e202-490b-42b0-b560-5efbc13a1885" acquired by "delete_volume" :: waited 0.026s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:11 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71 Jun 28 14:28:11 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31d0cd8-a445-4f1d-bfd9-13fbec7f7c3c]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:28:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e297e202-490b-42b0-b560-5efbc13a1885 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:11 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e297e202-490b-42b0-b560-5efbc13a1885 Jun 28 14:28:11 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:12 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-132baf80-a57b-4821-a589-c970d7c79655 1073741824" returned: 0 in 1.151s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-132baf80-a57b-4821-a589-c970d7c79655 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:12 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-132baf80-a57b-4821-a589-c970d7c79655 Jun 28 14:28:12 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:12 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71" returned: 0 in 1.191s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:12 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71 Jun 28 14:28:12 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:12 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e297e202-490b-42b0-b560-5efbc13a1885" returned: 0 in 1.082s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e297e202-490b-42b0-b560-5efbc13a1885 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:12 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e297e202-490b-42b0-b560-5efbc13a1885 Jun 28 14:28:12 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:13 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-132baf80-a57b-4821-a589-c970d7c79655" returned: 0 in 0.862s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:28:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381d9d33-fcba-4831-ada1-d87499516361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132baf80-a57b-4821-a589-c970d7c79655', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07637d58-204a-445e-9c65-99be04c4a847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:13 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Volume volume-132baf80-a57b-4821-a589-c970d7c79655 (132baf80-a57b-4821-a589-c970d7c79655): created successfully Jun 28 14:28:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07637d58-204a-445e-9c65-99be04c4a847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Flow 'volume_create_manager' (690e50d6-e914-4557-9d5c-6919695f00a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:28:13 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-8f1f790d-9757-42d7-ac64-5eef18d59ac1 tempest-VolumesTransfersV355Test-1424477 None] Created volume successfully. Jun 28 14:28:13 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71" returned: 0 in 1.142s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:13 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e297e202-490b-42b0-b560-5efbc13a1885" returned: 0 in 1.056s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Lock "cinder-quobyte-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71" released by "delete_volume" :: held 2.411s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Lock "cinder-quobyte-e297e202-490b-42b0-b560-5efbc13a1885" released by "delete_volume" :: held 2.236s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:14 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Created reservations ['3b219fc3-a844-4550-8e51-03882587b8c6', 'a5ba7af5-79dd-42fa-bc89-a2ea1508cd9c', '8629ce5c-3dd3-4834-b52a-1a68bade37dc', 'ec163906-c517-41ef-8770-aa6440cb68c8'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:28:14 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Created reservations ['db3c86fe-2bbe-4c9c-94d4-8ba87ccacd0f', '8f53cf88-14cf-45cd-95a4-97303817ac63', '2f5e366b-33ca-42f0-91f0-94d2e7bc4899', '11bb20e0-473a-4528-b7c2-486bd43bc16d'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:28:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:28:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:28:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:28:14 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:28:14 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:28:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:14 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:28:14 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:15 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Acquiring lock "cinder-921333c4-0ca1-41d2-909d-2f079acc9d1f-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.165s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:15 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:28:15 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Deleted volume successfully. Jun 28 14:28:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Lock "cinder-921333c4-0ca1-41d2-909d-2f079acc9d1f-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0e661f99-5e03-4ebf-b638-9098d5b1b1d5 tempest-VolumesListAdminTestJSON-570101872 None] Lock "cinder-9e1d4e7f-7e75-453c-b42c-fbd2e97d5b71-delete_volume" released by "delete_volume" :: held 3.926s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:15 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.264s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:15 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:28:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Acquiring lock "cinder-quobyte-921333c4-0ca1-41d2-909d-2f079acc9d1f" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:15 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Deleted volume successfully. Jun 28 14:28:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Lock "cinder-quobyte-921333c4-0ca1-41d2-909d-2f079acc9d1f" acquired by "delete_volume" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-252ce3a7-5186-463d-aeaa-b6a05f0db96d tempest-VolumesListAdminTestJSON-279869078 None] Lock "cinder-e297e202-490b-42b0-b560-5efbc13a1885-delete_volume" released by "delete_volume" :: held 3.862s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:15 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d96d6e-bc34-4c22-8690-4d7e493674eb]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:28:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-921333c4-0ca1-41d2-909d-2f079acc9d1f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:15 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ebb82566-ac01-456b-a3c5-c94d72869230 tempest-VolumesTransfersV355Test-1650003836 None] Transfer volume completed successfully. Jun 28 14:28:15 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-921333c4-0ca1-41d2-909d-2f079acc9d1f Jun 28 14:28:15 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:16 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-921333c4-0ca1-41d2-909d-2f079acc9d1f" returned: 0 in 0.822s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-921333c4-0ca1-41d2-909d-2f079acc9d1f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:16 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-921333c4-0ca1-41d2-909d-2f079acc9d1f Jun 28 14:28:16 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:16 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Acquiring lock "cinder-132baf80-a57b-4821-a589-c970d7c79655-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:16 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Lock "cinder-132baf80-a57b-4821-a589-c970d7c79655-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:16 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Acquiring lock "cinder-quobyte-132baf80-a57b-4821-a589-c970d7c79655" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:16 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Lock "cinder-quobyte-132baf80-a57b-4821-a589-c970d7c79655" acquired by "delete_volume" :: waited 0.025s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:16 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d72300-3a99-41f6-94ee-12fd2ba47ff6]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:28:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-132baf80-a57b-4821-a589-c970d7c79655 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:17 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-132baf80-a57b-4821-a589-c970d7c79655 Jun 28 14:28:17 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:17 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-921333c4-0ca1-41d2-909d-2f079acc9d1f" returned: 0 in 1.072s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Lock "cinder-quobyte-921333c4-0ca1-41d2-909d-2f079acc9d1f" released by "delete_volume" :: held 1.968s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:17 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Created reservations ['7278177b-0da6-42bf-9777-dd427e0aeb41', '689eecfe-25d0-45a0-b3fb-39d00510fcb5', '5d9e5b4e-5067-41d8-aa2a-686123845c21', 'f7f27c9d-fb18-4436-bc48-c8c1cd768bc8'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:28:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:28:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:28:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:17 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:28:17 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:18 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-132baf80-a57b-4821-a589-c970d7c79655" returned: 0 in 1.480s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-132baf80-a57b-4821-a589-c970d7c79655 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:18 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-132baf80-a57b-4821-a589-c970d7c79655 Jun 28 14:28:18 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Acquiring lock "cinder-6a0cab69-2869-4cd9-a647-2ab447014072-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Lock "cinder-6a0cab69-2869-4cd9-a647-2ab447014072-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Acquiring lock "cinder-quobyte-6a0cab69-2869-4cd9-a647-2ab447014072" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Lock "cinder-quobyte-6a0cab69-2869-4cd9-a647-2ab447014072" acquired by "delete_volume" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c8e324-b542-4597-9416-634a3ccee0f9]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6a0cab69-2869-4cd9-a647-2ab447014072 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:19 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.426s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:28:19 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Deleted volume successfully. Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-781db8d3-be0e-42f7-913b-2a08db5b56bf tempest-VolumesListAdminTestJSON-279869078 None] Lock "cinder-921333c4-0ca1-41d2-909d-2f079acc9d1f-delete_volume" released by "delete_volume" :: held 3.797s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:19 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6a0cab69-2869-4cd9-a647-2ab447014072 Jun 28 14:28:19 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:19 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-132baf80-a57b-4821-a589-c970d7c79655" returned: 0 in 1.090s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Lock "cinder-quobyte-132baf80-a57b-4821-a589-c970d7c79655" released by "delete_volume" :: held 2.653s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Created reservations ['ec527f72-375b-40ce-ac9d-6a65bef23f3e', 'f6e02916-8910-49d3-a14e-71e887949ae3', '0c810709-206a-419f-b54e-3bcfb0064de7', '91d7fae7-bdab-418a-aba4-9b8b8f5e50f8'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:19 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:28:19 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:20 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6a0cab69-2869-4cd9-a647-2ab447014072" returned: 0 in 1.239s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6a0cab69-2869-4cd9-a647-2ab447014072 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:20 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6a0cab69-2869-4cd9-a647-2ab447014072 Jun 28 14:28:20 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:20 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.966s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:20 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:28:20 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Deleted volume successfully. Jun 28 14:28:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f2ac1e6c-fbb9-4ac9-ab62-77c0bf9acd3f tempest-VolumesTransfersV355Test-1927177807 None] Lock "cinder-132baf80-a57b-4821-a589-c970d7c79655-delete_volume" released by "delete_volume" :: held 3.888s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Flow 'volume_create_manager' (e670aa46-cff1-4858-9797-c6cdff7a183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b01f96-c057-4c85-9ee0-2cbf02521d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b01f96-c057-4c85-9ee0-2cbf02521d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-586547854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=674774d0-6a05-4f25-87fe-cbbadbc59b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b25d6d84294a00bc3778315525aa28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:28:21Z,use_quota=True,user_id='352ad16a43d641efb095a62ee88618f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061b736d-bab5-42ea-a2f8-45964a350a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061b736d-bab5-42ea-a2f8-45964a350a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421acd95-b2e3-4538-b094-9c59c3f15b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421acd95-b2e3-4538-b094-9c59c3f15b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '674774d0-6a05-4f25-87fe-cbbadbc59b28', 'volume_name': 'volume-674774d0-6a05-4f25-87fe-cbbadbc59b28', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:21 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207d8b58-641c-4a83-a51b-114697f405ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207d8b58-641c-4a83-a51b-114697f405ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b06d06-1334-4a00-bbee-a42de00c662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:21 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Volume 674774d0-6a05-4f25-87fe-cbbadbc59b28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-674774d0-6a05-4f25-87fe-cbbadbc59b28', 'volume_size': 1} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-586547854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=674774d0-6a05-4f25-87fe-cbbadbc59b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b25d6d84294a00bc3778315525aa28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:28:21Z,use_quota=True,user_id='352ad16a43d641efb095a62ee88618f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Creating volume 674774d0-6a05-4f25-87fe-cbbadbc59b28 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:28:21 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-674774d0-6a05-4f25-87fe-cbbadbc59b28 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6a0cab69-2869-4cd9-a647-2ab447014072" returned: 0 in 1.029s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Lock "cinder-quobyte-6a0cab69-2869-4cd9-a647-2ab447014072" released by "delete_volume" :: held 2.344s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:21 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-674774d0-6a05-4f25-87fe-cbbadbc59b28 1073741824 Jun 28 14:28:21 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Created reservations ['d9505f24-b954-41be-9505-e3d9106182a9', '7a16321b-8db3-47a5-8d4c-0ebb5efd2c18', 'b2c9a856-74b7-443b-be55-b2db8347251d', '7e8782a7-a941-44a7-9254-bbb7aa696e26'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:21 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:28:21 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:23 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.783s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:23 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:28:23 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Deleted volume successfully. Jun 28 14:28:23 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a92a72ad-9fcf-4ec5-b9ce-bb75477dfb7e tempest-VolumesListAdminTestJSON-279869078 None] Lock "cinder-6a0cab69-2869-4cd9-a647-2ab447014072-delete_volume" released by "delete_volume" :: held 4.581s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:23 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-674774d0-6a05-4f25-87fe-cbbadbc59b28 1073741824" returned: 0 in 2.509s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-674774d0-6a05-4f25-87fe-cbbadbc59b28 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:23 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-674774d0-6a05-4f25-87fe-cbbadbc59b28 Jun 28 14:28:23 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:25 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-674774d0-6a05-4f25-87fe-cbbadbc59b28" returned: 0 in 1.298s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:25 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] <== create_volume: return (3862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:28:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.868s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:25 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=74,cinder:INSERT=22,cinder:UPDATE=113,cinder:DELETE=10 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:28:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b06d06-1334-4a00-bbee-a42de00c662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-674774d0-6a05-4f25-87fe-cbbadbc59b28', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200383b2-9716-480f-9960-659324099bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:25 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=85,cinder:INSERT=25,cinder:UPDATE=102,cinder:DELETE=9 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:28:25 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Volume volume-674774d0-6a05-4f25-87fe-cbbadbc59b28 (674774d0-6a05-4f25-87fe-cbbadbc59b28): created successfully Jun 28 14:28:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200383b2-9716-480f-9960-659324099bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Flow 'volume_create_manager' (e670aa46-cff1-4858-9797-c6cdff7a183e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:28:25 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-3aa580d3-55f8-47ab-916d-e1986e02de65 tempest-VolumesTransfersV355Test-1424477 None] Created volume successfully. Jun 28 14:28:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Acquiring lock "cinder-674774d0-6a05-4f25-87fe-cbbadbc59b28-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Lock "cinder-674774d0-6a05-4f25-87fe-cbbadbc59b28-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Acquiring lock "cinder-quobyte-674774d0-6a05-4f25-87fe-cbbadbc59b28" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Lock "cinder-quobyte-674774d0-6a05-4f25-87fe-cbbadbc59b28" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:26 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f980611-2be8-4893-a8b3-d832537bf269]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:28:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-674774d0-6a05-4f25-87fe-cbbadbc59b28 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:26 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-674774d0-6a05-4f25-87fe-cbbadbc59b28 Jun 28 14:28:26 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:27 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-674774d0-6a05-4f25-87fe-cbbadbc59b28" returned: 0 in 1.380s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-674774d0-6a05-4f25-87fe-cbbadbc59b28 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:28 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-674774d0-6a05-4f25-87fe-cbbadbc59b28 Jun 28 14:28:28 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:29 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-674774d0-6a05-4f25-87fe-cbbadbc59b28" returned: 0 in 1.196s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Lock "cinder-quobyte-674774d0-6a05-4f25-87fe-cbbadbc59b28" released by "delete_volume" :: held 2.710s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:29 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Created reservations ['bc3848d9-36d9-4639-a3b9-cb7fe31e29c5', '46984f2d-905c-4eb6-be62-e381c3077bfc', '17c0e252-194e-4e1c-9ec2-5652b45c8f27', '8e114d7e-79ba-4db7-82e8-3c32030ad7fd'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:28:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:28:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:28:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:29 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:28:29 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:31 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.693s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:31 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:28:31 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Deleted volume successfully. Jun 28 14:28:31 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4762bd73-a77b-445e-8d77-df3a67184d96 tempest-VolumesTransfersV355Test-1927177807 None] Lock "cinder-674774d0-6a05-4f25-87fe-cbbadbc59b28-delete_volume" released by "delete_volume" :: held 4.746s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Flow 'volume_create_manager' (c8739aaf-22cb-4709-9223-899c4b530796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c271f3-eba6-443e-9762-8d4ebe0f125e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c271f3-eba6-443e-9762-8d4ebe0f125e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1420422058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bdd863-e18b-4e26-b4c1-facf34f6953a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdcd25261f44009a69769bf74096a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:28:35Z,use_quota=True,user_id='088e04a100c0495e843cb67943fcb6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abcd33c-e636-4b6c-8498-a67f70dc880d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abcd33c-e636-4b6c-8498-a67f70dc880d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93919627-dee2-436f-8fad-875ba55bd5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93919627-dee2-436f-8fad-875ba55bd5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96bdd863-e18b-4e26-b4c1-facf34f6953a', 'volume_name': 'volume-96bdd863-e18b-4e26-b4c1-facf34f6953a', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e80da6-edd4-4e78-bf71-211c05b4d93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e80da6-edd4-4e78-bf71-211c05b4d93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d61b11-9beb-49e0-8220-2675d6db0685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:34 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Volume 96bdd863-e18b-4e26-b4c1-facf34f6953a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96bdd863-e18b-4e26-b4c1-facf34f6953a', 'volume_size': 1} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1420422058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bdd863-e18b-4e26-b4c1-facf34f6953a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdcd25261f44009a69769bf74096a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:28:35Z,use_quota=True,user_id='088e04a100c0495e843cb67943fcb6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Creating volume 96bdd863-e18b-4e26-b4c1-facf34f6953a {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:28:34 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:28:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:34 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a 1073741824 Jun 28 14:28:34 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:35 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a 1073741824" returned: 0 in 1.018s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:36 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a Jun 28 14:28:36 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:36 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a" returned: 0 in 0.698s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:28:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d61b11-9beb-49e0-8220-2675d6db0685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96bdd863-e18b-4e26-b4c1-facf34f6953a', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114a1ca1-e809-4ba4-950d-cfd0ce9d6879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:36 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Volume volume-96bdd863-e18b-4e26-b4c1-facf34f6953a (96bdd863-e18b-4e26-b4c1-facf34f6953a): created successfully Jun 28 14:28:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114a1ca1-e809-4ba4-950d-cfd0ce9d6879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Flow 'volume_create_manager' (c8739aaf-22cb-4709-9223-899c4b530796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:28:36 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-029823eb-acb6-4e4a-8f5f-0e799b5bea03 tempest-VolumesDeleteCascade-1771279615 None] Created volume successfully. Jun 28 14:28:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:28:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:28:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:28:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:37 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:28:37 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:38 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] Creating offline snapshot b98abe2a-c768-49f0-b066-69c4510824b5 of volume 96bdd863-e18b-4e26-b4c1-facf34f6953a {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:28:38 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9deadc0f-1c4a-4a8e-9e83-f99e62529aa5]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:28:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:38 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a Jun 28 14:28:38 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:38 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.787s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:28:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:28:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 8 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:28:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:28:39 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a" returned: 0 in 0.905s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:39 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 1G Jun 28 14:28:39 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:40 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 1G" returned: 0 in 0.822s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bdd863-e18b-4e26-b4c1-facf34f6953a -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:40 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bdd863-e18b-4e26-b4c1-facf34f6953a -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 Jun 28 14:28:40 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:40 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bdd863-e18b-4e26-b4c1-facf34f6953a -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5" returned: 0 in 0.749s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:40 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 is being set with open permissions: ugo+rw Jun 28 14:28:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:40 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 Jun 28 14:28:40 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:41 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5" returned: 0 in 0.691s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:41 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.info Jun 28 14:28:41 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:42 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.info" returned: 0 in 0.793s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:42 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.info is being set with open permissions: ugo+rw Jun 28 14:28:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:42 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.info Jun 28 14:28:42 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:43 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.info" returned: 0 in 0.662s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.747s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:43 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ba36135b-a268-4e02-a3a4-821a68c44e36 tempest-VolumesDeleteCascade-1771279615 None] Create snapshot completed successfully Jun 28 14:28:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1ab8ff82-4b43-4e48-90e6-e47ea777f8d0 tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1ab8ff82-4b43-4e48-90e6-e47ea777f8d0 tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-1ab8ff82-4b43-4e48-90e6-e47ea777f8d0 tempest-VolumesDeleteCascade-1771279615 None] Creating offline snapshot 0b3b450b-fa92-4a79-9e8e-64cad38d9a42 of volume 96bdd863-e18b-4e26-b4c1-facf34f6953a {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:28:44 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14f623b-242a-494f-ae8c-7e961500ac12]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:28:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ab8ff82-4b43-4e48-90e6-e47ea777f8d0 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:44 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 Jun 28 14:28:44 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:45 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ab8ff82-4b43-4e48-90e6-e47ea777f8d0 tempest-VolumesDeleteCascade-1771279615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5" returned: 0 in 1.017s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-1ab8ff82-4b43-4e48-90e6-e47ea777f8d0 tempest-VolumesDeleteCascade-1771279615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96bdd863-e18b-4e26-b4c1-facf34f6953a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:28:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ab8ff82-4b43-4e48-90e6-e47ea777f8d0 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:45 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42 1G Jun 28 14:28:45 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:45 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-d4d96c5e-017b-4acd-a006-1ba47bdb30f6 req-b24dbbda-5b7f-406c-83c6-348dbd3dd07d tempest-AttachVolumeTestJSON-144543565 None] Terminate volume connection completed successfully. Jun 28 14:28:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-d4d96c5e-017b-4acd-a006-1ba47bdb30f6 req-b24dbbda-5b7f-406c-83c6-348dbd3dd07d tempest-AttachVolumeTestJSON-144543565 None] Deleting attachment 04442b61-368d-4943-82e4-61fab6a8e856. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:28:46 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ab8ff82-4b43-4e48-90e6-e47ea777f8d0 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42 1G" returned: 0 in 1.083s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ab8ff82-4b43-4e48-90e6-e47ea777f8d0 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:46 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42 Jun 28 14:28:46 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:47 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ab8ff82-4b43-4e48-90e6-e47ea777f8d0 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42" returned: 0 in 0.918s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:47 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-1ab8ff82-4b43-4e48-90e6-e47ea777f8d0 tempest-VolumesDeleteCascade-1771279615 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42 is being set with open permissions: ugo+rw Jun 28 14:28:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ab8ff82-4b43-4e48-90e6-e47ea777f8d0 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:47 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42 Jun 28 14:28:47 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:47 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ab8ff82-4b43-4e48-90e6-e47ea777f8d0 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42" returned: 0 in 0.715s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1ab8ff82-4b43-4e48-90e6-e47ea777f8d0 tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.894s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:47 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-1ab8ff82-4b43-4e48-90e6-e47ea777f8d0 tempest-VolumesDeleteCascade-1771279615 None] Create snapshot completed successfully Jun 28 14:28:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-96bdd863-e18b-4e26-b4c1-facf34f6953a-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-96bdd863-e18b-4e26-b4c1-facf34f6953a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Performing cascade delete. {{(pid=93561) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 28 14:28:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-0b3b450b-fa92-4a79-9e8e-64cad38d9a42-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-0b3b450b-fa92-4a79-9e8e-64cad38d9a42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-quobyte-96bdd863-e18b-4e26-b4c1-facf34f6953a" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-96bdd863-e18b-4e26-b4c1-facf34f6953a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-quobyte-0b3b450b-fa92-4a79-9e8e-64cad38d9a42" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-0b3b450b-fa92-4a79-9e8e-64cad38d9a42" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Deleting offline snapshot 0b3b450b-fa92-4a79-9e8e-64cad38d9a42 of volume 96bdd863-e18b-4e26-b4c1-facf34f6953a {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:28:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] snapshot_file for this snap is: volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:28:48 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[41da263d-884a-436a-ade1-3fae769acfa3]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:28:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:48 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42 Jun 28 14:28:48 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:49 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42" returned: 0 in 1.019s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96bdd863-e18b-4e26-b4c1-facf34f6953a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:28:49 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df50c83-8e81-41a2-945a-886dfbf2780b]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:28:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:49 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 Jun 28 14:28:49 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Flow 'volume_create_manager' (2f8ec911-545a-4a98-a684-2beeaeaed6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11eb056-2797-49bf-baa1-2dd6799f78fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11eb056-2797-49bf-baa1-2dd6799f78fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-730342317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bbc09b-8448-4dbd-ad68-c87656dd8685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53b03d920b944498c5123d7442675b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:28:50Z,use_quota=True,user_id='d012956dda804bae870abbb79898d029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88fb574-8557-4512-8731-fdc8bce05f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88fb574-8557-4512-8731-fdc8bce05f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7d7dfe-bafd-4627-ad0c-654ce416c495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7d7dfe-bafd-4627-ad0c-654ce416c495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08bbc09b-8448-4dbd-ad68-c87656dd8685', 'volume_name': 'volume-08bbc09b-8448-4dbd-ad68-c87656dd8685', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592755a0-7585-4ad1-89ee-e656f0705bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592755a0-7585-4ad1-89ee-e656f0705bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db673c22-5a81-443a-83f5-e7ab012f66d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:50 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Volume 08bbc09b-8448-4dbd-ad68-c87656dd8685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08bbc09b-8448-4dbd-ad68-c87656dd8685', 'volume_size': 1} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-730342317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bbc09b-8448-4dbd-ad68-c87656dd8685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53b03d920b944498c5123d7442675b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:28:50Z,use_quota=True,user_id='d012956dda804bae870abbb79898d029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Creating volume 08bbc09b-8448-4dbd-ad68-c87656dd8685 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:28:50 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08bbc09b-8448-4dbd-ad68-c87656dd8685 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:50 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08bbc09b-8448-4dbd-ad68-c87656dd8685 1073741824 Jun 28 14:28:50 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:50 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5" returned: 0 in 0.901s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96bdd863-e18b-4e26-b4c1-facf34f6953a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:28:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:50 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42 Jun 28 14:28:50 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:51 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08bbc09b-8448-4dbd-ad68-c87656dd8685 1073741824" returned: 0 in 1.118s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08bbc09b-8448-4dbd-ad68-c87656dd8685 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:51 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08bbc09b-8448-4dbd-ad68-c87656dd8685 Jun 28 14:28:51 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:51 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42" returned: 0 in 1.007s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:51 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42 Jun 28 14:28:51 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:52 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08bbc09b-8448-4dbd-ad68-c87656dd8685" returned: 0 in 0.709s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db673c22-5a81-443a-83f5-e7ab012f66d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08bbc09b-8448-4dbd-ad68-c87656dd8685', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9b354a-8ae5-4d88-a87e-e9a540d2f194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:28:52 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Volume volume-08bbc09b-8448-4dbd-ad68-c87656dd8685 (08bbc09b-8448-4dbd-ad68-c87656dd8685): created successfully Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9b354a-8ae5-4d88-a87e-e9a540d2f194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Flow 'volume_create_manager' (2f8ec911-545a-4a98-a684-2beeaeaed6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:28:52 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ed8a19a3-467a-44ba-bb71-0b153521042d tempest-AttachVolumeNegativeTest-1777782759 None] Created volume successfully. Jun 28 14:28:52 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.0b3b450b-fa92-4a79-9e8e-64cad38d9a42" returned: 0 in 0.762s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-0b3b450b-fa92-4a79-9e8e-64cad38d9a42" released by "_delete_snapshot" :: held 3.825s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-96bdd863-e18b-4e26-b4c1-facf34f6953a" released by "delete_snapshot" :: held 3.849s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Created reservations ['12842865-3483-467c-aa09-bce04d09553c', '137fe9c7-5132-4cff-9fca-6a2b2482dd9e', 'e662d401-3aef-449e-ba84-fcd731e0edc9', '127eb9eb-7b77-4fe2-b7dc-a08454131765'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:28:52 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Delete snapshot completed successfully. Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-0b3b450b-fa92-4a79-9e8e-64cad38d9a42-delete_snapshot" released by "delete_snapshot" :: held 4.015s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-b98abe2a-c768-49f0-b066-69c4510824b5-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-b98abe2a-c768-49f0-b066-69c4510824b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-quobyte-96bdd863-e18b-4e26-b4c1-facf34f6953a" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-96bdd863-e18b-4e26-b4c1-facf34f6953a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-quobyte-b98abe2a-c768-49f0-b066-69c4510824b5" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-b98abe2a-c768-49f0-b066-69c4510824b5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Deleting offline snapshot b98abe2a-c768-49f0-b066-69c4510824b5 of volume 96bdd863-e18b-4e26-b4c1-facf34f6953a {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] snapshot_file for this snap is: volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac35d23-f119-4020-abbf-fbd50a24302c]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:28:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:52 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 Jun 28 14:28:52 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:53 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5" returned: 0 in 0.980s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:53 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96bdd863-e18b-4e26-b4c1-facf34f6953a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:28:53 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bca77f-4505-4270-a021-a0da1b3dc667]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:28:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:53 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a Jun 28 14:28:53 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:54 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a" returned: 0 in 1.013s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:54 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 Jun 28 14:28:54 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:55 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5" returned: 0 in 0.933s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:55 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5 Jun 28 14:28:55 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:56 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a.b98abe2a-c768-49f0-b066-69c4510824b5" returned: 0 in 0.851s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-b98abe2a-c768-49f0-b066-69c4510824b5" released by "_delete_snapshot" :: held 3.912s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-96bdd863-e18b-4e26-b4c1-facf34f6953a" released by "delete_snapshot" :: held 3.940s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:56 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Created reservations ['882191a2-97e4-4c52-8e59-5c4ea879d6f0', '7faa036c-c36c-4372-b80a-7ddd88b16f4b', '8e07bda1-b02d-490c-ab56-fbf72b2882be', 'a226b187-a136-4cdb-b58c-ee8e593d683a'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:28:56 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Delete snapshot completed successfully. Jun 28 14:28:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-b98abe2a-c768-49f0-b066-69c4510824b5-delete_snapshot" released by "delete_snapshot" :: held 4.136s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Snapshots deleted, issuing volume delete {{(pid=93561) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 28 14:28:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-quobyte-96bdd863-e18b-4e26-b4c1-facf34f6953a" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:28:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-96bdd863-e18b-4e26-b4c1-facf34f6953a" acquired by "delete_volume" :: waited 0.026s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:28:56 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[40edfcd6-7c2b-458d-a740-43e461f3cd7c]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:28:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:56 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a Jun 28 14:28:56 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-c4082197-b506-4800-9fbd-a69df0db422c req-790af928-2d14-4ae0-85f6-d93c19d26f20 tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-c4082197-b506-4800-9fbd-a69df0db422c req-790af928-2d14-4ae0-85f6-d93c19d26f20 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:57 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6220ac57-0071-4c75-8ba8-b6203480c83a]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:28:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-c4082197-b506-4800-9fbd-a69df0db422c req-790af928-2d14-4ae0-85f6-d93c19d26f20 tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08bbc09b-8448-4dbd-ad68-c87656dd8685 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:57 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08bbc09b-8448-4dbd-ad68-c87656dd8685 Jun 28 14:28:57 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:57 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a" returned: 0 in 0.854s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:57 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a Jun 28 14:28:57 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:58 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-c4082197-b506-4800-9fbd-a69df0db422c req-790af928-2d14-4ae0-85f6-d93c19d26f20 tempest-AttachVolumeNegativeTest-1777782759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08bbc09b-8448-4dbd-ad68-c87656dd8685" returned: 0 in 0.924s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-c4082197-b506-4800-9fbd-a69df0db422c req-790af928-2d14-4ae0-85f6-d93c19d26f20 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.944s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-c4082197-b506-4800-9fbd-a69df0db422c req-790af928-2d14-4ae0-85f6-d93c19d26f20 tempest-AttachVolumeNegativeTest-1777782759 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-08bbc09b-8448-4dbd-ad68-c87656dd8685', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aeba6b8b-def4-4fd1-8fb4-8c0534ba85a1', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:28:58 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-c4082197-b506-4800-9fbd-a69df0db422c req-790af928-2d14-4ae0-85f6-d93c19d26f20 tempest-AttachVolumeNegativeTest-1777782759 None] attachment_update completed successfully. Jun 28 14:28:58 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-96bdd863-e18b-4e26-b4c1-facf34f6953a" returned: 0 in 0.944s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:58 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-96bdd863-e18b-4e26-b4c1-facf34f6953a" released by "delete_volume" :: held 1.862s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:28:58 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Created reservations ['1f14e9a3-a3c6-4933-a694-883e0ac060fe', '0ca499d7-a6cb-4859-b7df-44ae8f6f871f', 'ee91d1ca-4bad-4556-9f87-334d61e43e34', '031d1ded-8574-4f4e-a4e1-b57da3a1a0b8'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:28:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:28:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:28:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:28:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:28:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:28:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:28:58 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:28:58 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:28:59 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Jun 28 14:28:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.805s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:28:59 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:28:59 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Deleted volume successfully. Jun 28 14:28:59 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba520988-4f3c-4a36-8ede-95c940f0804c tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-96bdd863-e18b-4e26-b4c1-facf34f6953a-delete_volume" released by "delete_volume" :: held 11.129s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Flow 'volume_create_manager' (48e476f5-721e-45a5-9337-3ae20bb8c6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf84461-d0db-4f80-b82c-d91e4d5ce323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf84461-d0db-4f80-b82c-d91e4d5ce323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1694349513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed6f2c2-8e50-41bd-8302-128d36b179cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdcd25261f44009a69769bf74096a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:29:00Z,use_quota=True,user_id='088e04a100c0495e843cb67943fcb6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b861c5-5f9c-4150-994e-ee9ba0b3b16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b861c5-5f9c-4150-994e-ee9ba0b3b16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be39b70-14d8-495f-811a-1c3a5b7b66f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be39b70-14d8-495f-811a-1c3a5b7b66f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ed6f2c2-8e50-41bd-8302-128d36b179cf', 'volume_name': 'volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb0bc82-a2ec-48a2-b3dd-f41519ef52ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb0bc82-a2ec-48a2-b3dd-f41519ef52ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591bc6d5-0e79-42e3-bc78-3c373f4a6f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:00 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Volume 6ed6f2c2-8e50-41bd-8302-128d36b179cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf', 'volume_size': 1} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1694349513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed6f2c2-8e50-41bd-8302-128d36b179cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdcd25261f44009a69769bf74096a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:29:00Z,use_quota=True,user_id='088e04a100c0495e843cb67943fcb6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Creating volume 6ed6f2c2-8e50-41bd-8302-128d36b179cf {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:29:00 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:29:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:00 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf 1073741824 Jun 28 14:29:00 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:01 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf 1073741824" returned: 0 in 1.191s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:01 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf Jun 28 14:29:01 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:02 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf" returned: 0 in 0.871s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:29:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.131s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591bc6d5-0e79-42e3-bc78-3c373f4a6f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e8c541-6bb9-418d-8c9a-ffc055c926cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:02 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Volume volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf (6ed6f2c2-8e50-41bd-8302-128d36b179cf): created successfully Jun 28 14:29:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e8c541-6bb9-418d-8c9a-ffc055c926cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Flow 'volume_create_manager' (48e476f5-721e-45a5-9337-3ae20bb8c6b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:29:02 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f3d21fa2-3d3a-491f-93a9-333491e516cb tempest-VolumesDeleteCascade-1771279615 None] Created volume successfully. Jun 28 14:29:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] Creating offline snapshot 90ec6d37-5d0d-4734-a57d-da49251e5b1c of volume 6ed6f2c2-8e50-41bd-8302-128d36b179cf {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:29:03 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe4d5c6-83c5-490a-a852-fd910c8f5ec7]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:29:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:03 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf Jun 28 14:29:03 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:05 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf" returned: 0 in 1.588s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:05 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c 1G Jun 28 14:29:05 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:05 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-745beee5-ab1d-4207-ad5b-91c63ce152da req-49e9cd59-8626-4d17-9288-e1165c78bc40 tempest-AttachVolumeNegativeTest-1777782759 None] Terminate volume connection completed successfully. Jun 28 14:29:05 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-745beee5-ab1d-4207-ad5b-91c63ce152da req-49e9cd59-8626-4d17-9288-e1165c78bc40 tempest-AttachVolumeNegativeTest-1777782759 None] Deleting attachment aeba6b8b-def4-4fd1-8fb4-8c0534ba85a1. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:29:06 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c 1G" returned: 0 in 1.047s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:06 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c Jun 28 14:29:06 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:06 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c" returned: 0 in 0.751s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:06 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c is being set with open permissions: ugo+rw Jun 28 14:29:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:07 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c Jun 28 14:29:07 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:07 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c" returned: 0 in 0.638s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:07 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.info Jun 28 14:29:07 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:08 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.info" returned: 0 in 0.694s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:08 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.info is being set with open permissions: ugo+rw Jun 28 14:29:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:08 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.info Jun 28 14:29:08 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:09 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.info" returned: 0 in 0.761s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.668s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:09 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7a6bb293-e8c4-4e7c-a752-18f67fc2dd64 tempest-VolumesDeleteCascade-1771279615 None] Create snapshot completed successfully Jun 28 14:29:10 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Flow 'volume_create_manager' (41bbf485-3d8b-42e7-9560-7b36c36a2cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84cdc46c-c80b-4dbf-935a-5770b7a3c1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84cdc46c-c80b-4dbf-935a-5770b7a3c1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-970568128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ab2941-6ad3-4889-a653-fb2dced07554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdcd25261f44009a69769bf74096a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=90ec6d37-5d0d-4734-a57d-da49251e5b1c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:29:11Z,use_quota=True,user_id='088e04a100c0495e843cb67943fcb6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33432af2-dedc-47ce-8314-c9dceca9b59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33432af2-dedc-47ce-8314-c9dceca9b59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11cc23e6-f36e-4707-9258-ec03a4536da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11cc23e6-f36e-4707-9258-ec03a4536da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c4ab2941-6ad3-4889-a653-fb2dced07554', 'volume_name': 'volume-c4ab2941-6ad3-4889-a653-fb2dced07554', 'volume_size': 1, 'snapshot_id': '90ec6d37-5d0d-4734-a57d-da49251e5b1c'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae3e6b2-0c4e-4f75-be0a-7b9daa89bece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae3e6b2-0c4e-4f75-be0a-7b9daa89bece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156ebba6-dd67-4a26-9122-2694f9047782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:11 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Volume c4ab2941-6ad3-4889-a653-fb2dced07554: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c4ab2941-6ad3-4889-a653-fb2dced07554', 'volume_size': 1, 'snapshot_id': '90ec6d37-5d0d-4734-a57d-da49251e5b1c'} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-quobyte-90ec6d37-5d0d-4734-a57d-da49251e5b1c-c4ab2941-6ad3-4889-a653-fb2dced07554" by "_create_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-90ec6d37-5d0d-4734-a57d-da49251e5b1c-c4ab2941-6ad3-4889-a653-fb2dced07554" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Creating volume c4ab2941-6ad3-4889-a653-fb2dced07554 from snapshot 90ec6d37-5d0d-4734-a57d-da49251e5b1c {{(pid=93561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-quobyte-c4ab2941-6ad3-4889-a653-fb2dced07554" by "_copy_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-c4ab2941-6ad3-4889-a653-fb2dced07554" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] snapshot: 90ec6d37-5d0d-4734-a57d-da49251e5b1c, volume: c4ab2941-6ad3-4889-a653-fb2dced07554, {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1055b00-23b1-4872-aaf4-523b550d2d86]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:29:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:11 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c Jun 28 14:29:11 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:12 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c" returned: 0 in 1.320s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:29:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 28 14:29:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Creating direct copy from snapshot {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 28 14:29:12 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[683bd70d-be0a-4911-a171-78ac7ccb2ba7]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:29:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:12 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf Jun 28 14:29:12 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:13 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf" returned: 0 in 1.087s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:13 devstack cinder-volume[93561]: DEBUG cinder.utils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Path /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c4ab2941-6ad3-4889-a653-fb2dced07554 not found in is_blk_device check {{(pid=93561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 28 14:29:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c4ab2941-6ad3-4889-a653-fb2dced07554 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:13 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c4ab2941-6ad3-4889-a653-fb2dced07554 Jun 28 14:29:13 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "cinder-08bbc09b-8448-4dbd-ad68-c87656dd8685-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Lock "cinder-08bbc09b-8448-4dbd-ad68-c87656dd8685-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "cinder-quobyte-08bbc09b-8448-4dbd-ad68-c87656dd8685" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Lock "cinder-quobyte-08bbc09b-8448-4dbd-ad68-c87656dd8685" acquired by "delete_volume" :: waited 0.054s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:18 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f208d64a-c428-40a0-9717-386a24df26a7]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:29:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08bbc09b-8448-4dbd-ad68-c87656dd8685 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:19 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08bbc09b-8448-4dbd-ad68-c87656dd8685 Jun 28 14:29:19 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:19 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c4ab2941-6ad3-4889-a653-fb2dced07554" returned: 0 in 5.907s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:19 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1254633-6112-4d90-b13d-5350ce834f39]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:29:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:19 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf Jun 28 14:29:19 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:20 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08bbc09b-8448-4dbd-ad68-c87656dd8685" returned: 0 in 1.296s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08bbc09b-8448-4dbd-ad68-c87656dd8685 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:20 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08bbc09b-8448-4dbd-ad68-c87656dd8685 Jun 28 14:29:20 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:20 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf" returned: 0 in 0.934s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:20 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Image conversion details: src /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c4ab2941-6ad3-4889-a653-fb2dced07554 {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:29:20 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Converted 1024.00 MB image at 173.30 MB/s Jun 28 14:29:20 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c4ab2941-6ad3-4889-a653-fb2dced07554 is being set with open permissions: ugo+rw Jun 28 14:29:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c4ab2941-6ad3-4889-a653-fb2dced07554 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:20 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c4ab2941-6ad3-4889-a653-fb2dced07554 Jun 28 14:29:20 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:20 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08bbc09b-8448-4dbd-ad68-c87656dd8685" returned: 0 in 0.663s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Lock "cinder-quobyte-08bbc09b-8448-4dbd-ad68-c87656dd8685" released by "delete_volume" :: held 2.046s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:20 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Created reservations ['b217e067-f1c4-4807-bbe3-44684693947c', '7afab53c-1680-4d41-83c6-f61ce95cba13', 'aabdc35d-b4d2-4ed4-ad48-0ec0662c7def', '1588d3e1-2787-4587-9b8d-00dcfcbacccd'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:29:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:20 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:29:20 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "cinder-c19b9ad0-88e9-4b61-86e6-da93e19b617e-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "cinder-c19b9ad0-88e9-4b61-86e6-da93e19b617e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "cinder-quobyte-c19b9ad0-88e9-4b61-86e6-da93e19b617e" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "cinder-quobyte-c19b9ad0-88e9-4b61-86e6-da93e19b617e" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:21 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0279cc7-fc8c-465c-abd0-7cd1ad72750d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:29:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:21 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:21 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e Jun 28 14:29:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c4ab2941-6ad3-4889-a653-fb2dced07554" returned: 0 in 0.880s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:21 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-c4ab2941-6ad3-4889-a653-fb2dced07554" released by "_copy_volume_from_snapshot" :: held 10.327s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-90ec6d37-5d0d-4734-a57d-da49251e5b1c-c4ab2941-6ad3-4889-a653-fb2dced07554" released by "_create_volume_from_snapshot" :: held 10.388s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.407s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156ebba6-dd67-4a26-9122-2694f9047782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ab2941-6ad3-4889-a653-fb2dced07554', 'volume_size': 1, 'snapshot_id': '90ec6d37-5d0d-4734-a57d-da49251e5b1c'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7ddab5-b7ee-4a65-b93f-c3bd51b1422f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:21 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Volume volume-c4ab2941-6ad3-4889-a653-fb2dced07554 (c4ab2941-6ad3-4889-a653-fb2dced07554): created successfully Jun 28 14:29:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7ddab5-b7ee-4a65-b93f-c3bd51b1422f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Flow 'volume_create_manager' (41bbf485-3d8b-42e7-9560-7b36c36a2cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:29:21 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-9a498899-8a0d-4cd4-9dca-3747f7ee799f tempest-VolumesDeleteCascade-1771279615 None] Created volume successfully. Jun 28 14:29:22 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.300s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:29:22 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Deleted volume successfully. Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-bb33f060-a5cb-4f1f-a4f8-4d8d9d5cc33b tempest-AttachVolumeNegativeTest-1777782759 None] Lock "cinder-08bbc09b-8448-4dbd-ad68-c87656dd8685-delete_volume" released by "delete_volume" :: held 3.737s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-6ed6f2c2-8e50-41bd-8302-128d36b179cf-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-6ed6f2c2-8e50-41bd-8302-128d36b179cf-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Performing cascade delete. {{(pid=93561) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-90ec6d37-5d0d-4734-a57d-da49251e5b1c-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-90ec6d37-5d0d-4734-a57d-da49251e5b1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-quobyte-6ed6f2c2-8e50-41bd-8302-128d36b179cf" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-6ed6f2c2-8e50-41bd-8302-128d36b179cf" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-quobyte-90ec6d37-5d0d-4734-a57d-da49251e5b1c" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-90ec6d37-5d0d-4734-a57d-da49251e5b1c" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Deleting offline snapshot 90ec6d37-5d0d-4734-a57d-da49251e5b1c of volume 6ed6f2c2-8e50-41bd-8302-128d36b179cf {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] snapshot_file for this snap is: volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a661cd7d-2413-48ff-9891-8b08b4db0441]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:22 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e" returned: 0 in 1.581s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:22 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c Jun 28 14:29:22 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:22 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e Jun 28 14:29:22 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:23 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c" returned: 0 in 0.993s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:29:23 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04b8eb1-4c4c-4d73-8189-1164437e8a52]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:29:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:23 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c19b9ad0-88e9-4b61-86e6-da93e19b617e" returned: 0 in 0.961s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:23 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "cinder-quobyte-c19b9ad0-88e9-4b61-86e6-da93e19b617e" released by "delete_volume" :: held 2.614s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:23 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf Jun 28 14:29:23 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:23 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Created reservations ['b642b854-3c03-47ee-ad69-50aeff087ed6', '3ef5d513-f9f2-48a7-a670-0dd819ac6612', 'a3e34bad-c7b4-4ca0-b771-c4e53db76b96', '543e87a7-316e-43f3-9081-102273c5dd7e'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:29:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:24 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:29:24 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:24 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf" returned: 0 in 1.048s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:24 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.862s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:24 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:29:24 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Deleted volume successfully. Jun 28 14:29:24 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c Jun 28 14:29:24 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:24 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-bb3132ba-f1c2-4582-8f12-86c6e3a39342 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "cinder-c19b9ad0-88e9-4b61-86e6-da93e19b617e-delete_volume" released by "delete_volume" :: held 3.833s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "cinder-58fb19d3-b425-4a45-a137-2937cbd4ce70-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "cinder-58fb19d3-b425-4a45-a137-2937cbd4ce70-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "cinder-quobyte-58fb19d3-b425-4a45-a137-2937cbd4ce70" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "cinder-quobyte-58fb19d3-b425-4a45-a137-2937cbd4ce70" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:25 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fd4c99-f3aa-4ed8-afca-a02b1f005798]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:29:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-58fb19d3-b425-4a45-a137-2937cbd4ce70 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:25 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-58fb19d3-b425-4a45-a137-2937cbd4ce70 Jun 28 14:29:25 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:26 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c" returned: 0 in 1.221s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:26 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c Jun 28 14:29:26 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:26 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-58fb19d3-b425-4a45-a137-2937cbd4ce70" returned: 0 in 1.031s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-58fb19d3-b425-4a45-a137-2937cbd4ce70 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:26 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-58fb19d3-b425-4a45-a137-2937cbd4ce70 Jun 28 14:29:26 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:27 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf.90ec6d37-5d0d-4734-a57d-da49251e5b1c" returned: 0 in 1.153s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-90ec6d37-5d0d-4734-a57d-da49251e5b1c" released by "_delete_snapshot" :: held 4.580s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-6ed6f2c2-8e50-41bd-8302-128d36b179cf" released by "delete_snapshot" :: held 4.655s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:27 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:DELETE=6,cinder:UPDATE=68,cinder:SELECT=56,cinder:INSERT=14 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:29:27 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:UPDATE=54,cinder:SELECT=64,cinder:INSERT=15,cinder:DELETE=6 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:29:27 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Created reservations ['c2dfe8c8-8e72-40bb-9beb-25cef8be5dc0', '34207181-0be7-4be1-9d9d-64129e09b57e', '71cc691f-5abe-455d-892b-30c5783f3825', 'b195bfec-68f0-4d18-930a-df79a95d1645'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:29:27 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Delete snapshot completed successfully. Jun 28 14:29:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-90ec6d37-5d0d-4734-a57d-da49251e5b1c-delete_snapshot" released by "delete_snapshot" :: held 4.967s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Snapshots deleted, issuing volume delete {{(pid=93561) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 28 14:29:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-quobyte-6ed6f2c2-8e50-41bd-8302-128d36b179cf" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-6ed6f2c2-8e50-41bd-8302-128d36b179cf" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:27 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc542971-c373-487a-9cd7-33f182c907ee]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:29:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:27 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf Jun 28 14:29:27 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:27 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-58fb19d3-b425-4a45-a137-2937cbd4ce70" returned: 0 in 1.483s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "cinder-quobyte-58fb19d3-b425-4a45-a137-2937cbd4ce70" released by "delete_volume" :: held 2.615s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:27 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Created reservations ['68a48ce4-e920-4bb9-877c-87061a396232', '26066004-b4d9-4742-ae07-19fc7d51165f', 'df8cd659-0b96-44ab-8dd6-f2522a898903', 'b266095f-9209-4f69-9a32-1b48f94d23b4'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:29:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:28 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:29:28 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:28 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf" returned: 0 in 1.217s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:28 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf Jun 28 14:29:28 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:29 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.275s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:29 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:29:29 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Deleted volume successfully. Jun 28 14:29:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-328565f0-dab7-463f-a969-ffd92cb7a403 tempest-AttachVolumeNegativeTest-1777782759 None] Lock "cinder-58fb19d3-b425-4a45-a137-2937cbd4ce70-delete_volume" released by "delete_volume" :: held 4.277s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:29 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6ed6f2c2-8e50-41bd-8302-128d36b179cf" returned: 0 in 1.007s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-6ed6f2c2-8e50-41bd-8302-128d36b179cf" released by "delete_volume" :: held 2.321s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:29 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Created reservations ['7e489139-b2fb-457c-aa36-69379f312967', '08a3c73c-7b48-4fbc-aac4-b92d2e7f8a89', '69f1bb39-9b1f-4d72-8e83-4852188fb843', 'c7f178c4-5e1f-4d1e-924b-b56d8635099c'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:29:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:30 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:29:30 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-c4ab2941-6ad3-4889-a653-fb2dced07554-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-c4ab2941-6ad3-4889-a653-fb2dced07554-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "cinder-quobyte-c4ab2941-6ad3-4889-a653-fb2dced07554" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-c4ab2941-6ad3-4889-a653-fb2dced07554" acquired by "delete_volume" :: waited 0.039s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:30 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b765a6cf-93f7-45d4-903d-c54d69065a9e]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:29:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c4ab2941-6ad3-4889-a653-fb2dced07554 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:31 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c4ab2941-6ad3-4889-a653-fb2dced07554 Jun 28 14:29:31 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:31 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.425s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:31 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:29:31 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Deleted volume successfully. Jun 28 14:29:31 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1fa3379c-755e-4a2a-b0c4-4a0c70e54995 tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-6ed6f2c2-8e50-41bd-8302-128d36b179cf-delete_volume" released by "delete_volume" :: held 9.100s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:32 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c4ab2941-6ad3-4889-a653-fb2dced07554" returned: 0 in 1.201s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c4ab2941-6ad3-4889-a653-fb2dced07554 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:32 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c4ab2941-6ad3-4889-a653-fb2dced07554 Jun 28 14:29:32 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:32 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c4ab2941-6ad3-4889-a653-fb2dced07554" returned: 0 in 0.740s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-quobyte-c4ab2941-6ad3-4889-a653-fb2dced07554" released by "delete_volume" :: held 2.013s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:32 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Created reservations ['264d494f-c406-493d-9dc6-1cbdf3ce08c0', '238c55cd-c753-45f7-922d-3916fcb5109d', 'bdd45b43-8cef-4c92-9f73-1d6b82700aa0', '6ce22bfe-19b0-420b-b69f-cb93fc3befbb'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:29:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:33 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:29:33 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:33 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.741s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:33 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:29:33 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Deleted volume successfully. Jun 28 14:29:33 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3d481f5f-3c79-466d-bc98-9c4104021464 tempest-VolumesDeleteCascade-1771279615 None] Lock "cinder-c4ab2941-6ad3-4889-a653-fb2dced07554-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:29:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:37 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:29:37 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:38 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.763s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:29:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:29:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 8 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:29:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Flow 'volume_create_manager' (342cd676-a814-4dd8-b2b1-58a582989cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e96e6e-68e4-4bb5-a9e9-5512490325ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e96e6e-68e4-4bb5-a9e9-5512490325ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-980184000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc11474-b4c6-4137-9e40-3aae0944ff79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919d3fb4a42441b390f5fa61e43af791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:29:40Z,use_quota=True,user_id='8738b76852934b0c92d722bdd0bf2a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2ffb20-4109-4ce2-b8bb-4c55144c0bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2ffb20-4109-4ce2-b8bb-4c55144c0bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f775b70e-d75e-4638-b925-823cf6a344c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f775b70e-d75e-4638-b925-823cf6a344c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dc11474-b4c6-4137-9e40-3aae0944ff79', 'volume_name': 'volume-1dc11474-b4c6-4137-9e40-3aae0944ff79', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8c12a9-4627-4d7c-a1c9-b5568fc58541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8c12a9-4627-4d7c-a1c9-b5568fc58541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbce31f-8748-457d-9f50-061e91f656d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:40 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Volume 1dc11474-b4c6-4137-9e40-3aae0944ff79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dc11474-b4c6-4137-9e40-3aae0944ff79', 'volume_size': 1} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-980184000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc11474-b4c6-4137-9e40-3aae0944ff79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919d3fb4a42441b390f5fa61e43af791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:29:40Z,use_quota=True,user_id='8738b76852934b0c92d722bdd0bf2a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Creating volume 1dc11474-b4c6-4137-9e40-3aae0944ff79 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:29:40 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:29:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1dc11474-b4c6-4137-9e40-3aae0944ff79 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:40 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1dc11474-b4c6-4137-9e40-3aae0944ff79 1073741824 Jun 28 14:29:40 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:41 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1dc11474-b4c6-4137-9e40-3aae0944ff79 1073741824" returned: 0 in 0.928s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1dc11474-b4c6-4137-9e40-3aae0944ff79 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:41 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1dc11474-b4c6-4137-9e40-3aae0944ff79 Jun 28 14:29:41 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:42 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1dc11474-b4c6-4137-9e40-3aae0944ff79" returned: 0 in 0.689s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:29:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbce31f-8748-457d-9f50-061e91f656d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dc11474-b4c6-4137-9e40-3aae0944ff79', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59ecaa8-ed03-490d-8303-9e7d08b3120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:42 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Volume volume-1dc11474-b4c6-4137-9e40-3aae0944ff79 (1dc11474-b4c6-4137-9e40-3aae0944ff79): created successfully Jun 28 14:29:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59ecaa8-ed03-490d-8303-9e7d08b3120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Flow 'volume_create_manager' (342cd676-a814-4dd8-b2b1-58a582989cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:29:42 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-fa437dcf-602f-4f6f-8de5-75929dec52ef tempest-VolumesTransfersTest-2136130622 None] Created volume successfully. Jun 28 14:29:43 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c7523ca3-315b-4df5-9053-e72ca8d87754 tempest-VolumesTransfersTest-513644617 None] Transfer volume completed successfully. Jun 28 14:29:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Acquiring lock "cinder-1dc11474-b4c6-4137-9e40-3aae0944ff79-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Lock "cinder-1dc11474-b4c6-4137-9e40-3aae0944ff79-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Acquiring lock "cinder-quobyte-1dc11474-b4c6-4137-9e40-3aae0944ff79" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Lock "cinder-quobyte-1dc11474-b4c6-4137-9e40-3aae0944ff79" acquired by "delete_volume" :: waited 0.081s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:45 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[426efc64-cc9b-4591-a5f6-01394810f13d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:29:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1dc11474-b4c6-4137-9e40-3aae0944ff79 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:45 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1dc11474-b4c6-4137-9e40-3aae0944ff79 Jun 28 14:29:45 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:45 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-4270747d-f520-49d3-9a80-3fc11efe1963 tempest-GroupsTest-1447466573 None] Group tempest-Group1-2127337103: creating Jun 28 14:29:45 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-4270747d-f520-49d3-9a80-3fc11efe1963 tempest-GroupsTest-1447466573 None] Group tempest-Group1-2127337103: created successfully Jun 28 14:29:45 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-4270747d-f520-49d3-9a80-3fc11efe1963 tempest-GroupsTest-1447466573 None] Create group completed successfully. Jun 28 14:29:46 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1dc11474-b4c6-4137-9e40-3aae0944ff79" returned: 0 in 1.046s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1dc11474-b4c6-4137-9e40-3aae0944ff79 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:46 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1dc11474-b4c6-4137-9e40-3aae0944ff79 Jun 28 14:29:46 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:46 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1dc11474-b4c6-4137-9e40-3aae0944ff79" returned: 0 in 0.697s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Lock "cinder-quobyte-1dc11474-b4c6-4137-9e40-3aae0944ff79" released by "delete_volume" :: held 1.804s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:46 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Created reservations ['7bc531ad-652d-49c3-b343-5e4e73020d93', '799c79f7-cba1-4164-a981-4fd82befc06a', 'd1076d48-a65a-4791-aea4-51b182f6aa18', 'd27f477f-b721-487c-ad94-c383ecaa5e81'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:29:46 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a4fa62bf-742b-4834-9bd7-fc6acaf8df8e tempest-GroupsTest-1447466573 None] Group tempest-Group2-246077897: creating Jun 28 14:29:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:46 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:29:46 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:46 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a4fa62bf-742b-4834-9bd7-fc6acaf8df8e tempest-GroupsTest-1447466573 None] Group tempest-Group2-246077897: created successfully Jun 28 14:29:46 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a4fa62bf-742b-4834-9bd7-fc6acaf8df8e tempest-GroupsTest-1447466573 None] Create group completed successfully. Jun 28 14:29:47 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.661s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:29:47 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Deleted volume successfully. Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-87eb5196-ba05-4950-9d14-985a414c935c tempest-VolumesTransfersTest-616851019 None] Lock "cinder-1dc11474-b4c6-4137-9e40-3aae0944ff79-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Flow 'volume_create_manager' (c1d647d6-9125-4d66-854c-75cb0f94ae4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa75104-de7e-4ff1-aea2-1040b8db2a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa75104-de7e-4ff1-aea2-1040b8db2a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-152663899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919d3fb4a42441b390f5fa61e43af791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:29:48Z,use_quota=True,user_id='8738b76852934b0c92d722bdd0bf2a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2865c7d9-6d0f-4bd7-965a-c13e87786738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2865c7d9-6d0f-4bd7-965a-c13e87786738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ba387f-7999-446c-8414-a46b50a714c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ba387f-7999-446c-8414-a46b50a714c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8', 'volume_name': 'volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76ab2cd-9b32-4895-b552-7cd276da35f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76ab2cd-9b32-4895-b552-7cd276da35f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf60da9-c0e6-4628-a4d0-ea35c52646fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:47 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Volume c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8', 'volume_size': 1} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-152663899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919d3fb4a42441b390f5fa61e43af791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:29:48Z,use_quota=True,user_id='8738b76852934b0c92d722bdd0bf2a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Creating volume c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:29:47 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:29:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:47 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8 1073741824 Jun 28 14:29:47 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:48 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:29:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Flow 'volume_create_manager' (81d97a76-3ea1-4cf9-8dfe-efdd201b8485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:29:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3eb9223-0479-4dd8-b18c-250b50648e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3eb9223-0479-4dd8-b18c-250b50648e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1504871403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8fecf13-6e57-4f67-b54c-3f8d54b3afef,host='devstack@QuobyteHD#QuobyteHD',id=235bb358-448b-4cad-8935-e59aa424aec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee3e42a52124d929364c6a93af3f82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:29:49Z,use_quota=True,user_id='734f3e35cc274586abccee2062299a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dbc7fa9-dd66-4fab-84aa-34f15b862eb2),volume_type_id=6dbc7fa9-dd66-4fab-84aa-34f15b862eb2)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8a996c-494b-427b-b61f-092d27318096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8a996c-494b-427b-b61f-092d27318096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af18b57-05d7-4831-bd1d-5a8ff1362892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af18b57-05d7-4831-bd1d-5a8ff1362892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '235bb358-448b-4cad-8935-e59aa424aec0', 'volume_name': 'volume-235bb358-448b-4cad-8935-e59aa424aec0', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40f5f2f-c674-46cd-b28e-78a2436a1632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40f5f2f-c674-46cd-b28e-78a2436a1632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae9f3a7-3e24-4934-b48f-ef9450de730c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:48 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Volume 235bb358-448b-4cad-8935-e59aa424aec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-235bb358-448b-4cad-8935-e59aa424aec0', 'volume_size': 1} Jun 28 14:29:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:48 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8 1073741824" returned: 0 in 0.979s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:48 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8 Jun 28 14:29:48 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:49 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8" returned: 0 in 0.658s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.788s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b8fecf13-6e57-4f67-b54c-3f8d54b3afef,created_at=2026-06-28T12:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1504871403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8fecf13-6e57-4f67-b54c-3f8d54b3afef,host='devstack@QuobyteHD#QuobyteHD',id=235bb358-448b-4cad-8935-e59aa424aec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee3e42a52124d929364c6a93af3f82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:29:49Z,use_quota=True,user_id='734f3e35cc274586abccee2062299a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dbc7fa9-dd66-4fab-84aa-34f15b862eb2),volume_type_id=6dbc7fa9-dd66-4fab-84aa-34f15b862eb2)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Creating volume 235bb358-448b-4cad-8935-e59aa424aec0 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:29:49 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-235bb358-448b-4cad-8935-e59aa424aec0 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf60da9-c0e6-4628-a4d0-ea35c52646fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:49 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-235bb358-448b-4cad-8935-e59aa424aec0 1073741824 Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be203305-7374-41f1-a3fa-0da7914abc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:49 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:49 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Volume volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8 (c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8): created successfully Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be203305-7374-41f1-a3fa-0da7914abc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Flow 'volume_create_manager' (c1d647d6-9125-4d66-854c-75cb0f94ae4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:29:49 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-93bbcb72-c41d-40c0-89f9-b0a7441d21f1 tempest-VolumesTransfersTest-2136130622 None] Created volume successfully. Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Flow 'volume_create_manager' (b0c5977e-a9fa-41d3-ace2-571ee87c6b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30cacb7-8461-4a2c-b431-788a4d8829de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30cacb7-8461-4a2c-b431-788a4d8829de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1081509996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9d8fc6-8736-4db9-875c-b05c687cbefe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e931f6c3624cbbad45c30708eaf35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:29:50Z,use_quota=True,user_id='2162e7e11b284587b49d39485a50d7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e565ef28-b180-486a-80e8-15b6eaec2895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e565ef28-b180-486a-80e8-15b6eaec2895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fefe6f-856f-46ea-9ef9-74a990fa0825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fefe6f-856f-46ea-9ef9-74a990fa0825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e9d8fc6-8736-4db9-875c-b05c687cbefe', 'volume_name': 'volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6f550f-45eb-440e-a702-472711583ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6f550f-45eb-440e-a702-472711583ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86b1553-8b15-4080-92ef-b6c7a6c9c97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:50 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Volume 4e9d8fc6-8736-4db9-875c-b05c687cbefe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe', 'volume_size': 1} Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Acquiring lock "cinder-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Lock "cinder-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Acquiring lock "cinder-quobyte-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Lock "cinder-quobyte-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[27443f5e-2795-4c8b-bfb8-35db754a765c]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:50 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8 Jun 28 14:29:50 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:50 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-235bb358-448b-4cad-8935-e59aa424aec0 1073741824" returned: 0 in 1.058s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-235bb358-448b-4cad-8935-e59aa424aec0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:50 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-235bb358-448b-4cad-8935-e59aa424aec0 Jun 28 14:29:50 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:51 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8" returned: 0 in 0.805s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:51 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8 Jun 28 14:29:51 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:51 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-235bb358-448b-4cad-8935-e59aa424aec0" returned: 0 in 0.664s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.210s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1081509996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9d8fc6-8736-4db9-875c-b05c687cbefe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e931f6c3624cbbad45c30708eaf35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:29:50Z,use_quota=True,user_id='2162e7e11b284587b49d39485a50d7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Creating volume 4e9d8fc6-8736-4db9-875c-b05c687cbefe {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:29:51 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae9f3a7-3e24-4934-b48f-ef9450de730c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-235bb358-448b-4cad-8935-e59aa424aec0', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:51 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe 1073741824 Jun 28 14:29:51 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912d8379-e9d7-41f9-922b-3d41e613cd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:51 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Volume volume-235bb358-448b-4cad-8935-e59aa424aec0 (235bb358-448b-4cad-8935-e59aa424aec0): created successfully Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912d8379-e9d7-41f9-922b-3d41e613cd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Flow 'volume_create_manager' (81d97a76-3ea1-4cf9-8dfe-efdd201b8485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:29:51 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-fa87f07a-e28b-4a2b-ab1b-e4e204ce979a tempest-GroupsTest-1447466573 None] Created volume successfully. Jun 28 14:29:51 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8" returned: 0 in 0.726s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Lock "cinder-quobyte-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8" released by "delete_volume" :: held 1.573s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Created reservations ['ccca169c-ff1e-48a9-8122-c29bfbe41a46', 'ffa3a7f4-3e51-45d7-ad16-1cf7fc751338', 'bbb4d4a9-b5c5-4862-ac0a-435361b73082', '00bfca5f-4d13-4758-b651-8c06ed8a09c8'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:52 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:29:52 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:52 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe 1073741824" returned: 0 in 1.196s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:52 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe Jun 28 14:29:52 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:53 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Acquiring lock "cinder-quobyte-235bb358-448b-4cad-8935-e59aa424aec0" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:29:53 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Lock "cinder-quobyte-235bb358-448b-4cad-8935-e59aa424aec0" acquired by "delete_volume" :: waited 0.026s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:29:53 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27a8e99-2c68-4fdd-960f-3fe1bbebdce6]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:29:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-235bb358-448b-4cad-8935-e59aa424aec0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:53 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-235bb358-448b-4cad-8935-e59aa424aec0 Jun 28 14:29:53 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:53 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.799s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:53 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:29:53 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Deleted volume successfully. Jun 28 14:29:53 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3435a8fd-d50e-43d6-bc2c-6bca2e708a2e tempest-VolumesTransfersTest-616851019 None] Lock "cinder-c0f8a9fb-63a6-4dc0-a14c-d89e7d7c26f8-delete_volume" released by "delete_volume" :: held 3.602s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:53 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe" returned: 0 in 1.454s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:53 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] <== create_volume: return (2720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:29:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.722s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86b1553-8b15-4080-92ef-b6c7a6c9c97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2f6104-c4b2-496d-a3ca-be6481a9edd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:29:54 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Volume volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe (4e9d8fc6-8736-4db9-875c-b05c687cbefe): created successfully Jun 28 14:29:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2f6104-c4b2-496d-a3ca-be6481a9edd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:29:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Flow 'volume_create_manager' (b0c5977e-a9fa-41d3-ace2-571ee87c6b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:29:54 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-08ee5ff3-7d5d-4b14-a748-ae321504d410 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Created volume successfully. Jun 28 14:29:54 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-235bb358-448b-4cad-8935-e59aa424aec0" returned: 0 in 0.999s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-235bb358-448b-4cad-8935-e59aa424aec0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:54 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-235bb358-448b-4cad-8935-e59aa424aec0 Jun 28 14:29:54 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:55 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-235bb358-448b-4cad-8935-e59aa424aec0" returned: 0 in 1.055s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Lock "cinder-quobyte-235bb358-448b-4cad-8935-e59aa424aec0" released by "delete_volume" :: held 2.147s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:29:55 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Created reservations ['a2ca8054-1117-4da1-b829-7d63ce9668a5'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:29:55 devstack cinder-volume[93561]: WARNING cinder.quota [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1029564725 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1029564725, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:29:55 devstack cinder-volume[93561]: WARNING cinder.quota [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1029564725 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1029564725, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:29:55 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Created reservations ['f92bcef0-162b-4f27-9c79-c08d818df792', 'aef10dd2-6acb-4e18-85f5-eb3b1c52e8fc', 'ef553b1c-e35b-40e6-b39b-3e60850093e5', 'e32de68c-2821-4718-b622-e236879c597e'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:29:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:56 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:29:56 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:56 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-59fa51ae-ae4c-4079-ba38-f38fd65e6580 tempest-GroupsTest-1447466573 None] Created reservations ['dcafa609-54d1-486e-8497-1e99c8d4a00b'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:29:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-59fa51ae-ae4c-4079-ba38-f38fd65e6580 tempest-GroupsTest-1447466573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-59fa51ae-ae4c-4079-ba38-f38fd65e6580 tempest-GroupsTest-1447466573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-59fa51ae-ae4c-4079-ba38-f38fd65e6580 tempest-GroupsTest-1447466573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:29:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-59fa51ae-ae4c-4079-ba38-f38fd65e6580 tempest-GroupsTest-1447466573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:29:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-59fa51ae-ae4c-4079-ba38-f38fd65e6580 tempest-GroupsTest-1447466573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:29:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-59fa51ae-ae4c-4079-ba38-f38fd65e6580 tempest-GroupsTest-1447466573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:56 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:29:56 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:57 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.405s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:57 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:29:57 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ca690f81-90dc-47b7-a520-3edf756c8563 tempest-GroupsTest-1447466573 None] Delete group completed successfully. Jun 28 14:29:57 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-59fa51ae-ae4c-4079-ba38-f38fd65e6580 tempest-GroupsTest-1447466573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.331s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:57 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-59fa51ae-ae4c-4079-ba38-f38fd65e6580 tempest-GroupsTest-1447466573 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:29:57 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-59fa51ae-ae4c-4079-ba38-f38fd65e6580 tempest-GroupsTest-1447466573 None] Delete group completed successfully. Jun 28 14:29:58 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c6fb175f-524f-4224-8929-aa7fce2be479 tempest-GroupsTest-1447466573 None] Group tempest-GroupsTest-Group-976590576: creating Jun 28 14:29:58 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c6fb175f-524f-4224-8929-aa7fce2be479 tempest-GroupsTest-1447466573 None] Group tempest-GroupsTest-Group-976590576: created successfully Jun 28 14:29:58 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c6fb175f-524f-4224-8929-aa7fce2be479 tempest-GroupsTest-1447466573 None] Create group completed successfully. Jun 28 14:29:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-6336624c-1412-4e44-ba93-a609e1feb151 req-e5d95029-c85b-4cc5-a18e-7247397fc140 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:29:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-6336624c-1412-4e44-ba93-a609e1feb151 req-e5d95029-c85b-4cc5-a18e-7247397fc140 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:29:58 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[736a94d8-2c5e-411e-9b54-a55106fc904f]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:29:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-6336624c-1412-4e44-ba93-a609e1feb151 req-e5d95029-c85b-4cc5-a18e-7247397fc140 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:29:58 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe Jun 28 14:29:58 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:29:59 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jun 28 14:29:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-6336624c-1412-4e44-ba93-a609e1feb151 req-e5d95029-c85b-4cc5-a18e-7247397fc140 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe" returned: 0 in 1.117s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:29:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-6336624c-1412-4e44-ba93-a609e1feb151 req-e5d95029-c85b-4cc5-a18e-7247397fc140 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.148s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-6336624c-1412-4e44-ba93-a609e1feb151 req-e5d95029-c85b-4cc5-a18e-7247397fc140 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9cdb5a15-bd7b-44aa-8ea5-ccf3981f0ae2', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:30:00 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-6336624c-1412-4e44-ba93-a609e1feb151 req-e5d95029-c85b-4cc5-a18e-7247397fc140 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] attachment_update completed successfully. Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Flow 'volume_create_manager' (09295b9b-a192-4f49-a063-194b58e5208d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027e9bb1-62d3-4262-914d-4dcfb4ead022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027e9bb1-62d3-4262-914d-4dcfb4ead022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-646266258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03cb7169-8482-4d65-9b08-4bb914f12923,host='devstack@QuobyteHD#QuobyteHD',id=8c85d707-75e1-4c27-9e21-4d9a779e71a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee3e42a52124d929364c6a93af3f82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:00Z,use_quota=True,user_id='734f3e35cc274586abccee2062299a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(141d7df0-dde3-4080-a283-f6567e7a48dc),volume_type_id=141d7df0-dde3-4080-a283-f6567e7a48dc)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a49816-6d88-4f18-8519-555d0eb7cc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a49816-6d88-4f18-8519-555d0eb7cc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6305499c-8a90-409a-95e4-81aa34613250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6305499c-8a90-409a-95e4-81aa34613250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c85d707-75e1-4c27-9e21-4d9a779e71a5', 'volume_name': 'volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ea2152-6802-405b-9c84-68be2c86c022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ea2152-6802-405b-9c84-68be2c86c022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bb2423-8271-4d3f-8f03-ef59171f56cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:00 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Volume 8c85d707-75e1-4c27-9e21-4d9a779e71a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5', 'volume_size': 1} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=03cb7169-8482-4d65-9b08-4bb914f12923,created_at=2026-06-28T12:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-646266258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03cb7169-8482-4d65-9b08-4bb914f12923,host='devstack@QuobyteHD#QuobyteHD',id=8c85d707-75e1-4c27-9e21-4d9a779e71a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee3e42a52124d929364c6a93af3f82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:00Z,use_quota=True,user_id='734f3e35cc274586abccee2062299a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(141d7df0-dde3-4080-a283-f6567e7a48dc),volume_type_id=141d7df0-dde3-4080-a283-f6567e7a48dc)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Creating volume 8c85d707-75e1-4c27-9e21-4d9a779e71a5 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:30:00 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:30:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:00 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5 1073741824 Jun 28 14:30:00 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:01 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5 1073741824" returned: 0 in 1.031s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:01 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5 Jun 28 14:30:01 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Flow 'volume_create_manager' (6cb845e9-ab55-4c82-b11d-99f1abd1eb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fcb60a8-5c36-42e2-9c57-f0d68cbd02e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fcb60a8-5c36-42e2-9c57-f0d68cbd02e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1321970219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45ca22e-5416-444a-8de8-72140d8e811c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ec73940ffc411a957594e7557afe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:02Z,use_quota=True,user_id='741d76e31e83419880162faa05b97842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3af4e0-6fcf-4898-856d-7c66620d890c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3af4e0-6fcf-4898-856d-7c66620d890c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcfeda5-51a8-45ab-be97-b44771523507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcfeda5-51a8-45ab-be97-b44771523507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c45ca22e-5416-444a-8de8-72140d8e811c', 'volume_name': 'volume-c45ca22e-5416-444a-8de8-72140d8e811c', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420e9926-f4c6-4e6f-828c-7bf190b52640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420e9926-f4c6-4e6f-828c-7bf190b52640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6086e657-e5ac-4e78-9e99-64e7ab313e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:02 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Volume c45ca22e-5416-444a-8de8-72140d8e811c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c45ca22e-5416-444a-8de8-72140d8e811c', 'volume_size': 1} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:02 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5" returned: 0 in 0.757s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.490s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1321970219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45ca22e-5416-444a-8de8-72140d8e811c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ec73940ffc411a957594e7557afe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:02Z,use_quota=True,user_id='741d76e31e83419880162faa05b97842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Creating volume c45ca22e-5416-444a-8de8-72140d8e811c {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:30:02 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bb2423-8271-4d3f-8f03-ef59171f56cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:02 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c 1073741824 Jun 28 14:30:02 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276165c7-48ca-416e-ba2c-a922b000c662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:02 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Volume volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5 (8c85d707-75e1-4c27-9e21-4d9a779e71a5): created successfully Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276165c7-48ca-416e-ba2c-a922b000c662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Flow 'volume_create_manager' (09295b9b-a192-4f49-a063-194b58e5208d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:02 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-2f55010f-44ac-431a-94d0-5289885a6462 tempest-GroupsTest-1447466573 None] Created volume successfully. Jun 28 14:30:03 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c 1073741824" returned: 0 in 0.928s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:03 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c Jun 28 14:30:03 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:03 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:30:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Flow 'volume_create_manager' (cd19ba09-3c47-4e58-80a9-753473a724cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be06ccb-ba92-4e89-903a-07404c741cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be06ccb-ba92-4e89-903a-07404c741cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-711453241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03cb7169-8482-4d65-9b08-4bb914f12923,host='devstack@QuobyteHD#QuobyteHD',id=537599f2-b7fd-4bad-a53d-5c45d357e28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee3e42a52124d929364c6a93af3f82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:04Z,use_quota=True,user_id='734f3e35cc274586abccee2062299a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(141d7df0-dde3-4080-a283-f6567e7a48dc),volume_type_id=141d7df0-dde3-4080-a283-f6567e7a48dc)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211638c1-dc50-4f52-9733-c82759463ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211638c1-dc50-4f52-9733-c82759463ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed32d84-9022-4ac7-bf2c-2844f2d75e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed32d84-9022-4ac7-bf2c-2844f2d75e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '537599f2-b7fd-4bad-a53d-5c45d357e28a', 'volume_name': 'volume-537599f2-b7fd-4bad-a53d-5c45d357e28a', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887d1887-919f-4d1e-bfe4-21d9f757dc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887d1887-919f-4d1e-bfe4-21d9f757dc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44d092d-502b-4cdc-9a9e-dd6e53743d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:04 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Volume 537599f2-b7fd-4bad-a53d-5c45d357e28a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-537599f2-b7fd-4bad-a53d-5c45d357e28a', 'volume_size': 1} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:04 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c" returned: 0 in 0.861s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.360s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=03cb7169-8482-4d65-9b08-4bb914f12923,created_at=2026-06-28T12:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-711453241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03cb7169-8482-4d65-9b08-4bb914f12923,host='devstack@QuobyteHD#QuobyteHD',id=537599f2-b7fd-4bad-a53d-5c45d357e28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee3e42a52124d929364c6a93af3f82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:04Z,use_quota=True,user_id='734f3e35cc274586abccee2062299a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(141d7df0-dde3-4080-a283-f6567e7a48dc),volume_type_id=141d7df0-dde3-4080-a283-f6567e7a48dc)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Creating volume 537599f2-b7fd-4bad-a53d-5c45d357e28a {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:30:04 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-537599f2-b7fd-4bad-a53d-5c45d357e28a 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6086e657-e5ac-4e78-9e99-64e7ab313e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c45ca22e-5416-444a-8de8-72140d8e811c', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:04 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-537599f2-b7fd-4bad-a53d-5c45d357e28a 1073741824 Jun 28 14:30:04 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e30225c1-24b2-4009-97ac-b26ef06133a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:04 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Volume volume-c45ca22e-5416-444a-8de8-72140d8e811c (c45ca22e-5416-444a-8de8-72140d8e811c): created successfully Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e30225c1-24b2-4009-97ac-b26ef06133a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Flow 'volume_create_manager' (6cb845e9-ab55-4c82-b11d-99f1abd1eb24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:04 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-235e5022-395e-4ce4-b782-5ca2638f3b55 tempest-VolumesSnapshotListTestJSON-2057770806 None] Created volume successfully. Jun 28 14:30:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:05 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-537599f2-b7fd-4bad-a53d-5c45d357e28a 1073741824" returned: 0 in 0.994s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-537599f2-b7fd-4bad-a53d-5c45d357e28a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:05 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-537599f2-b7fd-4bad-a53d-5c45d357e28a Jun 28 14:30:05 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:06 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-537599f2-b7fd-4bad-a53d-5c45d357e28a" returned: 0 in 0.752s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:30:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.834s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44d092d-502b-4cdc-9a9e-dd6e53743d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-537599f2-b7fd-4bad-a53d-5c45d357e28a', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac6025c-b8db-41cf-a6e6-3177c4d39f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] Creating offline snapshot 2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 of volume c45ca22e-5416-444a-8de8-72140d8e811c {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:30:06 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Volume volume-537599f2-b7fd-4bad-a53d-5c45d357e28a (537599f2-b7fd-4bad-a53d-5c45d357e28a): created successfully Jun 28 14:30:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac6025c-b8db-41cf-a6e6-3177c4d39f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Flow 'volume_create_manager' (cd19ba09-3c47-4e58-80a9-753473a724cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:06 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e487178-da8e-4275-9970-26fdcb935aca]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:06 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-0d2847fd-31f6-4722-82de-8d061e1523d3 tempest-GroupsTest-1447466573 None] Created volume successfully. Jun 28 14:30:06 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c Jun 28 14:30:06 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:06 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-07976978-d2e3-49b8-b013-f6c824c914fa tempest-GroupsTest-1447466573 None] Update group completed successfully. Jun 28 14:30:07 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c" returned: 0 in 0.898s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:07 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 1G Jun 28 14:30:07 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:07 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-2955de42-1432-43e1-b768-4cd53e3888b4 req-e3547f86-e012-4bb2-ae8f-261f3f25528f tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Terminate volume connection completed successfully. Jun 28 14:30:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-2955de42-1432-43e1-b768-4cd53e3888b4 req-e3547f86-e012-4bb2-ae8f-261f3f25528f tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Deleting attachment 9cdb5a15-bd7b-44aa-8ea5-ccf3981f0ae2. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:30:08 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 1G" returned: 0 in 0.884s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45ca22e-5416-444a-8de8-72140d8e811c -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:08 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45ca22e-5416-444a-8de8-72140d8e811c -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 Jun 28 14:30:08 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:08 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7f12be1f-3544-425f-9e5b-497a0a2d868d tempest-GroupsTest-1447466573 None] Update group completed successfully. Jun 28 14:30:08 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45ca22e-5416-444a-8de8-72140d8e811c -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0" returned: 0 in 0.719s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:08 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 is being set with open permissions: ugo+rw Jun 28 14:30:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:08 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 Jun 28 14:30:08 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:09 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0" returned: 0 in 0.667s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:09 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.info Jun 28 14:30:09 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Acquiring lock "cinder-4e9d8fc6-8736-4db9-875c-b05c687cbefe-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Lock "cinder-4e9d8fc6-8736-4db9-875c-b05c687cbefe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Acquiring lock "cinder-quobyte-4e9d8fc6-8736-4db9-875c-b05c687cbefe" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Lock "cinder-quobyte-4e9d8fc6-8736-4db9-875c-b05c687cbefe" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:09 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f100e1-05b6-4b2c-a4f0-22aab6f61d8c]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:10 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Acquiring lock "cinder-quobyte-537599f2-b7fd-4bad-a53d-5c45d357e28a" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:10 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Lock "cinder-quobyte-537599f2-b7fd-4bad-a53d-5c45d357e28a" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:10 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe Jun 28 14:30:10 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:10 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b28e70-fc0f-4efc-beb2-962d908b6ebb]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-537599f2-b7fd-4bad-a53d-5c45d357e28a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:10 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:10 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-537599f2-b7fd-4bad-a53d-5c45d357e28a Jun 28 14:30:10 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.info" returned: 0 in 0.726s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:10 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.info is being set with open permissions: ugo+rw Jun 28 14:30:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:10 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.info Jun 28 14:30:10 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:10 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe" returned: 0 in 0.812s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:10 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe Jun 28 14:30:10 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:10 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-537599f2-b7fd-4bad-a53d-5c45d357e28a" returned: 0 in 0.841s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-537599f2-b7fd-4bad-a53d-5c45d357e28a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:10 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:10 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-537599f2-b7fd-4bad-a53d-5c45d357e28a Jun 28 14:30:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.info" returned: 0 in 0.722s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:10 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.741s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:11 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-50fc1382-626e-485d-8494-0c92b449088d tempest-VolumesSnapshotListTestJSON-2057770806 None] Create snapshot completed successfully Jun 28 14:30:11 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4e9d8fc6-8736-4db9-875c-b05c687cbefe" returned: 0 in 0.671s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Lock "cinder-quobyte-4e9d8fc6-8736-4db9-875c-b05c687cbefe" released by "delete_volume" :: held 1.535s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:11 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Created reservations ['f2ce918c-0565-44de-b60d-9e1ae96acead', '3403e8ed-2a57-4c15-b9c0-b511082bc401', 'd38f5f98-f6b5-4c7d-b76e-4ee141ff9554', 'c9d2cdcc-755b-4609-a72a-531ffb91be7d'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:30:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:11 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:30:11 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:11 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-537599f2-b7fd-4bad-a53d-5c45d357e28a" returned: 0 in 0.695s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Lock "cinder-quobyte-537599f2-b7fd-4bad-a53d-5c45d357e28a" released by "delete_volume" :: held 1.590s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Acquiring lock "cinder-quobyte-8c85d707-75e1-4c27-9e21-4d9a779e71a5" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Lock "cinder-quobyte-8c85d707-75e1-4c27-9e21-4d9a779e71a5" acquired by "delete_volume" :: waited 0.013s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:11 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcce7fd-2cbd-4b9a-a24f-083337281453]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:11 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5 Jun 28 14:30:11 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0a2c60b1-83b8-4f33-9ee6-e6dfe61e2903 tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0a2c60b1-83b8-4f33-9ee6-e6dfe61e2903 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-0a2c60b1-83b8-4f33-9ee6-e6dfe61e2903 tempest-VolumesSnapshotListTestJSON-2057770806 None] Creating offline snapshot 9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a of volume c45ca22e-5416-444a-8de8-72140d8e811c {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:30:12 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f47610-1750-491c-a7bc-4b010a48084b]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0a2c60b1-83b8-4f33-9ee6-e6dfe61e2903 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:12 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.786s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:12 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:30:12 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Deleted volume successfully. Jun 28 14:30:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2f435e43-216d-486b-8612-54113f91aee0 tempest-TestServerVolumeAttachScenarioOldVersion-999329494 None] Lock "cinder-4e9d8fc6-8736-4db9-875c-b05c687cbefe-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:12 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 Jun 28 14:30:12 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:12 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5" returned: 0 in 1.257s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:12 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5 Jun 28 14:30:12 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:13 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0a2c60b1-83b8-4f33-9ee6-e6dfe61e2903 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0" returned: 0 in 0.980s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-0a2c60b1-83b8-4f33-9ee6-e6dfe61e2903 tempest-VolumesSnapshotListTestJSON-2057770806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45ca22e-5416-444a-8de8-72140d8e811c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:30:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0a2c60b1-83b8-4f33-9ee6-e6dfe61e2903 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:13 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a 1G Jun 28 14:30:13 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:13 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8c85d707-75e1-4c27-9e21-4d9a779e71a5" returned: 0 in 0.801s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Lock "cinder-quobyte-8c85d707-75e1-4c27-9e21-4d9a779e71a5" released by "delete_volume" :: held 2.113s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:14 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Created reservations ['59db5461-b852-4dc9-933a-63d68b924d7c'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:30:14 devstack cinder-volume[93561]: WARNING cinder.quota [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-3671502 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-3671502, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:30:14 devstack cinder-volume[93561]: WARNING cinder.quota [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-3671502 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-3671502, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:30:14 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Created reservations ['23644e8a-5190-4a67-a4a8-c60bcc730f5d', '47b0969e-b18e-4bb0-b71e-bb373ac54775', '85ef6359-61d8-4755-bbce-852cee40abb3', '61081722-66df-4a06-ad24-7de08f08526f'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:30:14 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Created reservations ['1be5ee6d-b1b5-4a78-836e-466d4f0420bc', 'e0b23f68-74ea-4604-9628-449e62d6944e', 'a60a6274-e1a1-4eb4-9057-86698d655b7c', '6983923e-47c0-4bb6-86a6-a13539deb0cc'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:30:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:14 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:30:14 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:14 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0a2c60b1-83b8-4f33-9ee6-e6dfe61e2903 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a 1G" returned: 0 in 1.479s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0a2c60b1-83b8-4f33-9ee6-e6dfe61e2903 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:14 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a Jun 28 14:30:14 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:15 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.706s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:15 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:30:15 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-21caf7b2-7279-475e-8d59-7dff2f35b9ef tempest-GroupsTest-1447466573 None] Delete group completed successfully. Jun 28 14:30:15 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0a2c60b1-83b8-4f33-9ee6-e6dfe61e2903 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a" returned: 0 in 0.771s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:15 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-0a2c60b1-83b8-4f33-9ee6-e6dfe61e2903 tempest-VolumesSnapshotListTestJSON-2057770806 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a is being set with open permissions: ugo+rw Jun 28 14:30:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0a2c60b1-83b8-4f33-9ee6-e6dfe61e2903 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:15 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a Jun 28 14:30:15 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:16 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0a2c60b1-83b8-4f33-9ee6-e6dfe61e2903 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a" returned: 0 in 0.856s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0a2c60b1-83b8-4f33-9ee6-e6dfe61e2903 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.262s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:16 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-0a2c60b1-83b8-4f33-9ee6-e6dfe61e2903 tempest-VolumesSnapshotListTestJSON-2057770806 None] Create snapshot completed successfully Jun 28 14:30:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7e9aa615-088f-4911-952c-8ebc31aa326e tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7e9aa615-088f-4911-952c-8ebc31aa326e tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-7e9aa615-088f-4911-952c-8ebc31aa326e tempest-VolumesSnapshotListTestJSON-2057770806 None] Creating offline snapshot 8209ac73-754c-4dac-ba0a-200c3db9a9dc of volume c45ca22e-5416-444a-8de8-72140d8e811c {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:30:17 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb02b380-4634-4d1b-93e4-44222d0843f3]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7e9aa615-088f-4911-952c-8ebc31aa326e tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:17 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a Jun 28 14:30:17 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:18 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7e9aa615-088f-4911-952c-8ebc31aa326e tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a" returned: 0 in 0.807s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-7e9aa615-088f-4911-952c-8ebc31aa326e tempest-VolumesSnapshotListTestJSON-2057770806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45ca22e-5416-444a-8de8-72140d8e811c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:30:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7e9aa615-088f-4911-952c-8ebc31aa326e tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:18 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc 1G Jun 28 14:30:18 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:19 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:30:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Flow 'volume_create_manager' (85ab32a7-3387-4b7b-bb20-907494119d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bc4c54-a6e1-4a19-a030-b6b0d618cde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bc4c54-a6e1-4a19-a030-b6b0d618cde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1171434752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=147aeb45-7144-43c4-bf29-ee3d779e54c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455d5d9e4e7d4efab897b16308f78d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:19Z,use_quota=True,user_id='9dea6156f9914e80bc2a50a6c01055b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2765cffc-4871-43d0-a3bf-d8c3b77827ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2765cffc-4871-43d0-a3bf-d8c3b77827ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1a9930-f97f-4b49-b189-4a399a1d549e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1a9930-f97f-4b49-b189-4a399a1d549e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '147aeb45-7144-43c4-bf29-ee3d779e54c0', 'volume_name': 'volume-147aeb45-7144-43c4-bf29-ee3d779e54c0', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a09931-f6a2-421f-bedd-8a607b4b3e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a09931-f6a2-421f-bedd-8a607b4b3e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e75ba5-00a6-4836-aa6c-15fcb1e5aec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:19 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Volume 147aeb45-7144-43c4-bf29-ee3d779e54c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-147aeb45-7144-43c4-bf29-ee3d779e54c0', 'volume_size': 1} Jun 28 14:30:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:19 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7e9aa615-088f-4911-952c-8ebc31aa326e tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc 1G" returned: 0 in 1.062s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7e9aa615-088f-4911-952c-8ebc31aa326e tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:19 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc Jun 28 14:30:19 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:20 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7e9aa615-088f-4911-952c-8ebc31aa326e tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc" returned: 0 in 0.734s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:20 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-7e9aa615-088f-4911-952c-8ebc31aa326e tempest-VolumesSnapshotListTestJSON-2057770806 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc is being set with open permissions: ugo+rw Jun 28 14:30:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7e9aa615-088f-4911-952c-8ebc31aa326e tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:20 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc Jun 28 14:30:20 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:20 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7e9aa615-088f-4911-952c-8ebc31aa326e tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc" returned: 0 in 0.722s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7e9aa615-088f-4911-952c-8ebc31aa326e tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.450s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.768s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1171434752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=147aeb45-7144-43c4-bf29-ee3d779e54c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455d5d9e4e7d4efab897b16308f78d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:19Z,use_quota=True,user_id='9dea6156f9914e80bc2a50a6c01055b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:30:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Creating volume 147aeb45-7144-43c4-bf29-ee3d779e54c0 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:30:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:30:20 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:30:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-147aeb45-7144-43c4-bf29-ee3d779e54c0 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:21 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-147aeb45-7144-43c4-bf29-ee3d779e54c0 1073741824 Jun 28 14:30:21 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:21 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7e9aa615-088f-4911-952c-8ebc31aa326e tempest-VolumesSnapshotListTestJSON-2057770806 None] Create snapshot completed successfully Jun 28 14:30:21 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:30:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Flow 'volume_create_manager' (c04ab2a4-cb4d-4bae-80a4-ea79694b3594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a24f21-73f7-4381-a971-b3c17065bf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a24f21-73f7-4381-a971-b3c17065bf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-410358253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee729bedc4ab47ddb875a1846a663e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:22Z,use_quota=True,user_id='a263a643093348bfabcd14ce16ec47d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4dbd6fb-0c29-48e6-bcf8-047bc8346082),volume_type_id=e4dbd6fb-0c29-48e6-bcf8-047bc8346082)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95922f8c-a4b3-434b-a41b-b57226afaf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95922f8c-a4b3-434b-a41b-b57226afaf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843a2ecf-ed1f-4146-82cf-837efa89c392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843a2ecf-ed1f-4146-82cf-837efa89c392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e', 'volume_name': 'volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b8f41ed-b60f-4ffc-954b-c7386fd9267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b8f41ed-b60f-4ffc-954b-c7386fd9267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e793378d-6274-425a-ba6f-b244b65c1814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:21 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Volume 34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e', 'volume_size': 1} Jun 28 14:30:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:22 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-147aeb45-7144-43c4-bf29-ee3d779e54c0 1073741824" returned: 0 in 1.029s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-147aeb45-7144-43c4-bf29-ee3d779e54c0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:22 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-147aeb45-7144-43c4-bf29-ee3d779e54c0 Jun 28 14:30:22 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "cinder-8209ac73-754c-4dac-ba0a-200c3db9a9dc-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-8209ac73-754c-4dac-ba0a-200c3db9a9dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "cinder-quobyte-c45ca22e-5416-444a-8de8-72140d8e811c" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-quobyte-c45ca22e-5416-444a-8de8-72140d8e811c" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "cinder-quobyte-8209ac73-754c-4dac-ba0a-200c3db9a9dc" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-quobyte-8209ac73-754c-4dac-ba0a-200c3db9a9dc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Deleting offline snapshot 8209ac73-754c-4dac-ba0a-200c3db9a9dc of volume c45ca22e-5416-444a-8de8-72140d8e811c {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] snapshot_file for this snap is: volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a28259-d6ea-4544-9010-8821482919bf]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:22 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-147aeb45-7144-43c4-bf29-ee3d779e54c0" returned: 0 in 0.805s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.069s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-410358253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee729bedc4ab47ddb875a1846a663e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:22Z,use_quota=True,user_id='a263a643093348bfabcd14ce16ec47d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4dbd6fb-0c29-48e6-bcf8-047bc8346082),volume_type_id=e4dbd6fb-0c29-48e6-bcf8-047bc8346082)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Creating volume 34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:30:22 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:22 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc Jun 28 14:30:22 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e75ba5-00a6-4836-aa6c-15fcb1e5aec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-147aeb45-7144-43c4-bf29-ee3d779e54c0', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62219006-f01c-4669-a0b3-2becd9c693b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:22 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e 1073741824 Jun 28 14:30:22 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:22 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Volume volume-147aeb45-7144-43c4-bf29-ee3d779e54c0 (147aeb45-7144-43c4-bf29-ee3d779e54c0): created successfully Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62219006-f01c-4669-a0b3-2becd9c693b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Flow 'volume_create_manager' (85ab32a7-3387-4b7b-bb20-907494119d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:22 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c1e10624-81d4-4098-a495-1f7cfe1c421a tempest-AttachVolumeTestJSON-144543565 None] Created volume successfully. Jun 28 14:30:23 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc" returned: 0 in 0.915s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45ca22e-5416-444a-8de8-72140d8e811c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:30:23 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7067c7e9-bbb5-45eb-8968-149b940888af]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:23 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a Jun 28 14:30:23 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:23 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e 1073741824" returned: 0 in 1.035s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:24 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e Jun 28 14:30:24 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:24 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a" returned: 0 in 0.863s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45ca22e-5416-444a-8de8-72140d8e811c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:30:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:24 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc Jun 28 14:30:24 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:24 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e" returned: 0 in 0.830s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:30:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e793378d-6274-425a-ba6f-b244b65c1814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270e84ef-8716-4755-b0c0-c3e835ee7c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:24 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Volume volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e (34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e): created successfully Jun 28 14:30:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270e84ef-8716-4755-b0c0-c3e835ee7c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Flow 'volume_create_manager' (c04ab2a4-cb4d-4bae-80a4-ea79694b3594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:24 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-3f172a2f-7d47-47a7-8064-ed7968e5e46f tempest-VolumeTypesAccessTest-1654870726 None] Created volume successfully. Jun 28 14:30:25 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc" returned: 0 in 0.868s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:25 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc Jun 28 14:30:25 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Acquiring lock "cinder-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Lock "cinder-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Acquiring lock "cinder-quobyte-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Lock "cinder-quobyte-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e" acquired by "delete_volume" :: waited 0.020s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd357bb-6794-4b54-b7c6-720db359721d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:26 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.8209ac73-754c-4dac-ba0a-200c3db9a9dc" returned: 0 in 0.774s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-quobyte-8209ac73-754c-4dac-ba0a-200c3db9a9dc" released by "_delete_snapshot" :: held 3.552s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-quobyte-c45ca22e-5416-444a-8de8-72140d8e811c" released by "delete_snapshot" :: held 3.585s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:26 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e Jun 28 14:30:26 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Created reservations ['ea6651d0-8ca9-4b0a-b110-dfaf7b9174cc', 'e9a48900-9e33-4024-aa76-769bcef6d112', '14a25d66-31b6-4050-ac21-18640453ebe7', '95b4f720-f500-4451-bcf2-aca43e8a4abc'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:30:26 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Delete snapshot completed successfully. Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-daf904b0-2d63-40aa-b30f-dfc44fd18ce2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-8209ac73-754c-4dac-ba0a-200c3db9a9dc-delete_snapshot" released by "delete_snapshot" :: held 3.781s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-355d1fcd-347d-47df-8dcf-4b70f493a53f req-ab75cd7f-ba2c-4a4a-8f75-06e0a4382ae7 tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-355d1fcd-347d-47df-8dcf-4b70f493a53f req-ab75cd7f-ba2c-4a4a-8f75-06e0a4382ae7 tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bf85ac-d547-4f6d-8c64-9d4cc7f3c0b5]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-355d1fcd-347d-47df-8dcf-4b70f493a53f req-ab75cd7f-ba2c-4a4a-8f75-06e0a4382ae7 tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-147aeb45-7144-43c4-bf29-ee3d779e54c0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:26 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-147aeb45-7144-43c4-bf29-ee3d779e54c0 Jun 28 14:30:26 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "cinder-9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "cinder-quobyte-c45ca22e-5416-444a-8de8-72140d8e811c" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-quobyte-c45ca22e-5416-444a-8de8-72140d8e811c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "cinder-quobyte-9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-quobyte-9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Deleting offline snapshot 9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a of volume c45ca22e-5416-444a-8de8-72140d8e811c {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] snapshot_file for this snap is: volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4e17f6-cabf-4e3f-9bc4-2807b9d0a4c4]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:27 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e" returned: 0 in 1.005s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:27 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e Jun 28 14:30:27 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:27 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a Jun 28 14:30:27 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:27 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-355d1fcd-347d-47df-8dcf-4b70f493a53f req-ab75cd7f-ba2c-4a4a-8f75-06e0a4382ae7 tempest-AttachVolumeTestJSON-144543565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-147aeb45-7144-43c4-bf29-ee3d779e54c0" returned: 0 in 0.950s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-355d1fcd-347d-47df-8dcf-4b70f493a53f req-ab75cd7f-ba2c-4a4a-8f75-06e0a4382ae7 tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.967s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:INSERT=31,cinder:UPDATE=136,cinder:SELECT=99,cinder:DELETE=8 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=117,cinder:INSERT=26,cinder:UPDATE=119,cinder:DELETE=10 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-355d1fcd-347d-47df-8dcf-4b70f493a53f req-ab75cd7f-ba2c-4a4a-8f75-06e0a4382ae7 tempest-AttachVolumeTestJSON-144543565 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-147aeb45-7144-43c4-bf29-ee3d779e54c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91380ae5-9af8-48e8-aeb8-94258d960e12', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:30:27 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-355d1fcd-347d-47df-8dcf-4b70f493a53f req-ab75cd7f-ba2c-4a4a-8f75-06e0a4382ae7 tempest-AttachVolumeTestJSON-144543565 None] attachment_update completed successfully. Jun 28 14:30:27 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e" returned: 0 in 0.781s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:27 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Lock "cinder-quobyte-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e" released by "delete_volume" :: held 1.846s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:28 devstack cinder-volume[93561]: WARNING cinder.quota [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1100015966 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1100015966, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:30:28 devstack cinder-volume[93561]: WARNING cinder.quota [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1100015966 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1100015966, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:30:28 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a" returned: 0 in 0.970s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45ca22e-5416-444a-8de8-72140d8e811c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:30:28 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Created reservations ['5382f302-09d5-4a1b-82e8-071fdd4b90ce', '6efa0346-1e15-4d8b-b69c-d79b91785ab3', 'f7b8678f-a23a-49f8-bd76-3373d412396c', '9f4b5ebb-0561-4eb1-b9e1-9ea338e6e234'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:30:28 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f173763c-042b-41cc-bf88-b3a49a3bdcce]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:28 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:30:28 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:28 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 Jun 28 14:30:28 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:29 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.893s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:29 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:30:29 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Deleted volume successfully. Jun 28 14:30:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c1d3ce8a-62a9-4875-b9d0-cfee60991bb2 tempest-VolumeTypesAccessTest-1654870726 None] Lock "cinder-34fd1d5c-8213-4ba1-a18b-2cd0e4e0bd4e-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:29 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0" returned: 0 in 1.240s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45ca22e-5416-444a-8de8-72140d8e811c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:30:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:29 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a Jun 28 14:30:29 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:30 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a" returned: 0 in 0.951s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:30 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a Jun 28 14:30:30 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:31 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a" returned: 0 in 0.788s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:31 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-quobyte-9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a" released by "_delete_snapshot" :: held 4.111s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:31 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-quobyte-c45ca22e-5416-444a-8de8-72140d8e811c" released by "delete_snapshot" :: held 4.145s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:31 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Created reservations ['78aa6c4a-4ea0-45bc-a54b-8e854772152e', 'ce1caf90-d00f-4a5e-9d8b-446ec6581e8c', '3c692b65-e6c3-4b0a-ae41-237f92a40e6b', '3c96fd23-a865-4de1-8cb1-9a711b5f9dc1'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:30:31 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Delete snapshot completed successfully. Jun 28 14:30:31 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ad9627bd-b1cd-413f-b92e-16e8e493a9c9 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-9d5c7e39-eaf4-46de-8d97-c7825c4c9c1a-delete_snapshot" released by "delete_snapshot" :: held 4.357s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "cinder-2ffb3b15-ba56-46e3-bfa9-95fb37a79db0-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-2ffb3b15-ba56-46e3-bfa9-95fb37a79db0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "cinder-quobyte-c45ca22e-5416-444a-8de8-72140d8e811c" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-quobyte-c45ca22e-5416-444a-8de8-72140d8e811c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "cinder-quobyte-2ffb3b15-ba56-46e3-bfa9-95fb37a79db0" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-quobyte-2ffb3b15-ba56-46e3-bfa9-95fb37a79db0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Deleting offline snapshot 2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 of volume c45ca22e-5416-444a-8de8-72140d8e811c {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:30:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] snapshot_file for this snap is: volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:30:32 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[69343f28-2c89-4870-a1f3-1efa1e57d695]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:32 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 Jun 28 14:30:32 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Flow 'volume_create_manager' (314d9e80-09d5-41ea-bb3a-c53f1915da4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fbcbec9-4659-4d61-a043-06c888bedf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fbcbec9-4659-4d61-a043-06c888bedf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-248945943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92dd891c-6d89-473c-bf00-3dc28fa2644b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a48a91a4f3645fba4836d1c81673614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:33Z,use_quota=True,user_id='36cd51cebd3f4376acb5ed38c47cdc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa01421-ea2c-47d7-a3e3-8270123e7830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa01421-ea2c-47d7-a3e3-8270123e7830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000a220d-643a-480f-8e97-a995f07e77e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000a220d-643a-480f-8e97-a995f07e77e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92dd891c-6d89-473c-bf00-3dc28fa2644b', 'volume_name': 'volume-92dd891c-6d89-473c-bf00-3dc28fa2644b', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a239f0b0-a4f3-49bd-bf5e-224bb04a974d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a239f0b0-a4f3-49bd-bf5e-224bb04a974d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90778511-98a1-4203-98bb-460acae10094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:33 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume 92dd891c-6d89-473c-bf00-3dc28fa2644b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92dd891c-6d89-473c-bf00-3dc28fa2644b', 'volume_size': 1} Jun 28 14:30:33 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-248945943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92dd891c-6d89-473c-bf00-3dc28fa2644b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a48a91a4f3645fba4836d1c81673614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:33Z,use_quota=True,user_id='36cd51cebd3f4376acb5ed38c47cdc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Creating volume 92dd891c-6d89-473c-bf00-3dc28fa2644b {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:30:33 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0" returned: 0 in 1.099s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45ca22e-5416-444a-8de8-72140d8e811c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:30:33 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b 1073741824 Jun 28 14:30:33 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[482b05b7-d455-4c42-87e0-7a96ebb95b64]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:33 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c Jun 28 14:30:33 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Flow 'volume_create_manager' (c647da9c-9ab3-4f94-8324-6c7780cfb6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa77acb-4199-4e16-b60a-95c11ff9226e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa77acb-4199-4e16-b60a-95c11ff9226e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-259264509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16187686-7661-483d-8836-b22ec205655b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455d5d9e4e7d4efab897b16308f78d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:34Z,use_quota=True,user_id='9dea6156f9914e80bc2a50a6c01055b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593a7dd2-4c26-4a80-b495-3b4f1c96d3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593a7dd2-4c26-4a80-b495-3b4f1c96d3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98232d6e-08e2-4f83-bfca-4d6b975bb0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98232d6e-08e2-4f83-bfca-4d6b975bb0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16187686-7661-483d-8836-b22ec205655b', 'volume_name': 'volume-16187686-7661-483d-8836-b22ec205655b', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd25f45c-3776-465d-bb9c-c5ee13b372d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd25f45c-3776-465d-bb9c-c5ee13b372d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9529864-876e-4cb8-95a6-acd206bd458e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:33 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Volume 16187686-7661-483d-8836-b22ec205655b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16187686-7661-483d-8836-b22ec205655b', 'volume_size': 1} Jun 28 14:30:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:34 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c" returned: 0 in 0.860s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:34 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 Jun 28 14:30:34 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:34 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b 1073741824" returned: 0 in 0.987s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:34 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b Jun 28 14:30:34 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:35 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0" returned: 0 in 0.763s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:35 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0 Jun 28 14:30:35 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:35 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b" returned: 0 in 0.726s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.341s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-259264509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16187686-7661-483d-8836-b22ec205655b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455d5d9e4e7d4efab897b16308f78d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:34Z,use_quota=True,user_id='9dea6156f9914e80bc2a50a6c01055b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Creating volume 16187686-7661-483d-8836-b22ec205655b {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:30:35 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16187686-7661-483d-8836-b22ec205655b 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90778511-98a1-4203-98bb-460acae10094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92dd891c-6d89-473c-bf00-3dc28fa2644b', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2da973c-4157-4718-8d40-48c70e9a4a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:35 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16187686-7661-483d-8836-b22ec205655b 1073741824 Jun 28 14:30:35 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:35 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume volume-92dd891c-6d89-473c-bf00-3dc28fa2644b (92dd891c-6d89-473c-bf00-3dc28fa2644b): created successfully Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2da973c-4157-4718-8d40-48c70e9a4a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Flow 'volume_create_manager' (314d9e80-09d5-41ea-bb3a-c53f1915da4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:35 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-82fd1582-7f14-4000-871c-f4d5acc0b23b tempest-CreateVolumesFromSnapshotTest-129904273 None] Created volume successfully. Jun 28 14:30:35 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c.2ffb3b15-ba56-46e3-bfa9-95fb37a79db0" returned: 0 in 0.694s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-quobyte-2ffb3b15-ba56-46e3-bfa9-95fb37a79db0" released by "_delete_snapshot" :: held 3.568s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-quobyte-c45ca22e-5416-444a-8de8-72140d8e811c" released by "delete_snapshot" :: held 3.599s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:35 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Created reservations ['1eaed869-2177-4498-87a6-967baa36945b', '1257f459-31a2-44c6-9e20-6705e37b478e', 'ee8bba81-29d5-46d0-9a73-958011fb2c41', '8e7e8ac0-d0bc-4b1a-91a8-170f2d4b8d1b'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:30:36 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Delete snapshot completed successfully. Jun 28 14:30:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-deaedf32-01a0-4a81-9477-a3c79f96bba2 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-2ffb3b15-ba56-46e3-bfa9-95fb37a79db0-delete_snapshot" released by "delete_snapshot" :: held 3.759s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:36 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16187686-7661-483d-8836-b22ec205655b 1073741824" returned: 0 in 0.952s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16187686-7661-483d-8836-b22ec205655b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:36 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16187686-7661-483d-8836-b22ec205655b Jun 28 14:30:36 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "cinder-c45ca22e-5416-444a-8de8-72140d8e811c-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-c45ca22e-5416-444a-8de8-72140d8e811c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "cinder-quobyte-c45ca22e-5416-444a-8de8-72140d8e811c" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-quobyte-c45ca22e-5416-444a-8de8-72140d8e811c" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:36 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90ec944-6f45-469f-b530-a0b742acfcfa]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:37 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16187686-7661-483d-8836-b22ec205655b" returned: 0 in 0.799s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.423s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] Creating offline snapshot 926979e8-8402-406a-9c6e-1b16db11065e of volume 92dd891c-6d89-473c-bf00-3dc28fa2644b {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9529864-876e-4cb8-95a6-acd206bd458e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16187686-7661-483d-8836-b22ec205655b', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:37 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c Jun 28 14:30:37 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4165a648-b281-433c-8261-8eb0643aee5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[185c3df1-c4e6-4434-8967-d57d874ac808]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:37 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Volume volume-16187686-7661-483d-8836-b22ec205655b (16187686-7661-483d-8836-b22ec205655b): created successfully Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4165a648-b281-433c-8261-8eb0643aee5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Flow 'volume_create_manager' (c647da9c-9ab3-4f94-8324-6c7780cfb6ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:37 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-2a14b9c6-bf90-48c4-9ee5-83fbcc370836 tempest-AttachVolumeTestJSON-144543565 None] Created volume successfully. Jun 28 14:30:37 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b Jun 28 14:30:37 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:37 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c" returned: 0 in 0.829s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:37 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c Jun 28 14:30:37 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:37 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:30:37 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:38 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b" returned: 0 in 1.011s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:38 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e 1G Jun 28 14:30:38 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:38 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.813s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:30:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:30:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 8 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:30:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:30:38 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c45ca22e-5416-444a-8de8-72140d8e811c" returned: 0 in 1.146s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:38 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-quobyte-c45ca22e-5416-444a-8de8-72140d8e811c" released by "delete_volume" :: held 2.071s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:39 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Created reservations ['0f4e9f71-377e-4cda-a7f3-c188f6afff14', '2d45bae4-1d14-4eaa-8dff-e797f9e59344', 'a41ec16b-9d9a-4cf7-ba63-e30386ed22d7', '4cf54311-4d75-4b5d-a61f-80926e5e1307'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:30:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:39 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:30:39 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:39 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e 1G" returned: 0 in 1.329s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92dd891c-6d89-473c-bf00-3dc28fa2644b -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:39 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92dd891c-6d89-473c-bf00-3dc28fa2644b -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e Jun 28 14:30:39 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:39 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.792s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:39 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:30:39 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Deleted volume successfully. Jun 28 14:30:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5a1f5993-4aad-42e4-ada5-316465061163 tempest-VolumesSnapshotListTestJSON-2057770806 None] Lock "cinder-c45ca22e-5416-444a-8de8-72140d8e811c-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:40 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92dd891c-6d89-473c-bf00-3dc28fa2644b -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e" returned: 0 in 0.834s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:40 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e is being set with open permissions: ugo+rw Jun 28 14:30:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:40 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e Jun 28 14:30:40 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:41 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e" returned: 0 in 0.782s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:41 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.info Jun 28 14:30:41 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-95e2f083-6fe9-4b27-b6c6-8fa18563929e req-943fd96f-2e69-4f6c-8406-37ba50d7fa46 tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:41 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.info" returned: 0 in 0.831s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:41 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.info is being set with open permissions: ugo+rw Jun 28 14:30:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:41 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.info Jun 28 14:30:41 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:42 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.info" returned: 0 in 0.731s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.641s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-95e2f083-6fe9-4b27-b6c6-8fa18563929e req-943fd96f-2e69-4f6c-8406-37ba50d7fa46 tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.991s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:42 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-334e6de7-2fe0-4658-91e4-310db031527d tempest-CreateVolumesFromSnapshotTest-129904273 None] Create snapshot completed successfully Jun 28 14:30:42 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7282e1-b120-40b3-ac6d-7e1518dbc47b]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-95e2f083-6fe9-4b27-b6c6-8fa18563929e req-943fd96f-2e69-4f6c-8406-37ba50d7fa46 tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16187686-7661-483d-8836-b22ec205655b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:42 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16187686-7661-483d-8836-b22ec205655b Jun 28 14:30:42 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:43 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-95e2f083-6fe9-4b27-b6c6-8fa18563929e req-943fd96f-2e69-4f6c-8406-37ba50d7fa46 tempest-AttachVolumeTestJSON-144543565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16187686-7661-483d-8836-b22ec205655b" returned: 0 in 0.975s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-95e2f083-6fe9-4b27-b6c6-8fa18563929e req-943fd96f-2e69-4f6c-8406-37ba50d7fa46 tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-95e2f083-6fe9-4b27-b6c6-8fa18563929e req-943fd96f-2e69-4f6c-8406-37ba50d7fa46 tempest-AttachVolumeTestJSON-144543565 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-16187686-7661-483d-8836-b22ec205655b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97d3c7a5-1633-445e-8127-30241378102b', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:30:43 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-95e2f083-6fe9-4b27-b6c6-8fa18563929e req-943fd96f-2e69-4f6c-8406-37ba50d7fa46 tempest-AttachVolumeTestJSON-144543565 None] attachment_update completed successfully. Jun 28 14:30:43 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:30:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Flow 'volume_create_manager' (57682be2-cafd-494e-88f7-c114135a511f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf87442-b75a-4700-b3db-066de8b9da13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf87442-b75a-4700-b3db-066de8b9da13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1777765088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9ebf4f-6048-42a1-8b3f-918c014b4cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a48a91a4f3645fba4836d1c81673614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:44Z,use_quota=True,user_id='36cd51cebd3f4376acb5ed38c47cdc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393abdb7-0933-4e32-a9a1-08b1ec738123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393abdb7-0933-4e32-a9a1-08b1ec738123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b53df92-9b10-40d8-b748-e31fd81366f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b53df92-9b10-40d8-b748-e31fd81366f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc9ebf4f-6048-42a1-8b3f-918c014b4cc8', 'volume_name': 'volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e211f001-8ab3-4956-9d76-7aec0590cf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e211f001-8ab3-4956-9d76-7aec0590cf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c70adc7-850a-4d76-8aa4-c17bacbcbecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:44 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume dc9ebf4f-6048-42a1-8b3f-918c014b4cc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8', 'volume_size': 1} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1777765088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9ebf4f-6048-42a1-8b3f-918c014b4cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a48a91a4f3645fba4836d1c81673614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:44Z,use_quota=True,user_id='36cd51cebd3f4376acb5ed38c47cdc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Creating volume dc9ebf4f-6048-42a1-8b3f-918c014b4cc8 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:30:44 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:44 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8 1073741824 Jun 28 14:30:44 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Flow 'volume_create_manager' (8110e596-fac1-4e0f-9dd9-7fe6b30f121b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff289a0b-c111-42f2-8baf-5ab58e0c4f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff289a0b-c111-42f2-8baf-5ab58e0c4f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1159752638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f0dc56-6cc8-422b-9b1f-aa104451e4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a48a91a4f3645fba4836d1c81673614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:45Z,use_quota=True,user_id='36cd51cebd3f4376acb5ed38c47cdc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3e6004-ede3-4faf-bed4-e46bc3474165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3e6004-ede3-4faf-bed4-e46bc3474165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b754b6df-6f1f-415b-b929-4521c00d7ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b754b6df-6f1f-415b-b929-4521c00d7ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98f0dc56-6cc8-422b-9b1f-aa104451e4e7', 'volume_name': 'volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe341c6a-a745-4690-9a53-5b97b6a5871f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe341c6a-a745-4690-9a53-5b97b6a5871f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e291cfe-7650-4eff-96bd-b787f4c37ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:44 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume 98f0dc56-6cc8-422b-9b1f-aa104451e4e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7', 'volume_size': 1} Jun 28 14:30:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Flow 'volume_create_manager' (ace13083-b6ba-4d74-84c8-ba9e409f2f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5e13d5-c19c-4603-8706-2d1af17fc40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5e13d5-c19c-4603-8706-2d1af17fc40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1860350222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d02a29-7c57-471c-b687-f8034a8cf309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a48a91a4f3645fba4836d1c81673614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:45Z,use_quota=True,user_id='36cd51cebd3f4376acb5ed38c47cdc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:45 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a600d0a1-20a3-497c-83ba-2397c0f2d82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a600d0a1-20a3-497c-83ba-2397c0f2d82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08783e65-b749-4c0b-8b20-cdae719a501d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08783e65-b749-4c0b-8b20-cdae719a501d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07d02a29-7c57-471c-b687-f8034a8cf309', 'volume_name': 'volume-07d02a29-7c57-471c-b687-f8034a8cf309', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d8aaa7-1897-442d-9ccd-16c13b609805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d8aaa7-1897-442d-9ccd-16c13b609805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f637b5b1-7b07-4bf9-9c59-79151ed9177d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:45 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume 07d02a29-7c57-471c-b687-f8034a8cf309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07d02a29-7c57-471c-b687-f8034a8cf309', 'volume_size': 1} Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8 1073741824" returned: 0 in 1.490s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:45 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8 Jun 28 14:30:45 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Flow 'volume_create_manager' (0407c0ab-7db4-42fa-beaa-abf795e2473e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e45d05-507d-4307-b7c9-c1154dd5a768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e45d05-507d-4307-b7c9-c1154dd5a768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-911062345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2702158e-5d43-4b35-a072-5c14423e0e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a48a91a4f3645fba4836d1c81673614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:46Z,use_quota=True,user_id='36cd51cebd3f4376acb5ed38c47cdc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3c0b54-5c1c-4078-b12b-284d2515365a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3c0b54-5c1c-4078-b12b-284d2515365a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29beaabc-d856-462f-9a84-3a65147f5f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29beaabc-d856-462f-9a84-3a65147f5f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2702158e-5d43-4b35-a072-5c14423e0e27', 'volume_name': 'volume-2702158e-5d43-4b35-a072-5c14423e0e27', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887cfdf7-ae17-4a86-b3d8-e0bc15739709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887cfdf7-ae17-4a86-b3d8-e0bc15739709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a91ba78-8613-434b-9207-91c06ff58c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:46 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume 2702158e-5d43-4b35-a072-5c14423e0e27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2702158e-5d43-4b35-a072-5c14423e0e27', 'volume_size': 1} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:30:46 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Flow 'volume_create_manager' (5eab2a5c-89df-4558-829a-6e6cfc3922e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4c8357-3166-4255-843b-40bad9c53258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8" returned: 0 in 1.017s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] <== create_volume: return (2562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.564s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.602s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1159752638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f0dc56-6cc8-422b-9b1f-aa104451e4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a48a91a4f3645fba4836d1c81673614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:45Z,use_quota=True,user_id='36cd51cebd3f4376acb5ed38c47cdc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Creating volume 98f0dc56-6cc8-422b-9b1f-aa104451e4e7 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:30:46 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4c8357-3166-4255-843b-40bad9c53258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-530293941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2463eb9e-ff65-42a6-8a65-f8865a7e49ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a48a91a4f3645fba4836d1c81673614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:46Z,use_quota=True,user_id='36cd51cebd3f4376acb5ed38c47cdc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef8dd18-5202-4841-a3b1-5fb0d17a5aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:46 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7 1073741824 Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef8dd18-5202-4841-a3b1-5fb0d17a5aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:46 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4952a4d-2977-48ef-8d86-ab9643dd57df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4952a4d-2977-48ef-8d86-ab9643dd57df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2463eb9e-ff65-42a6-8a65-f8865a7e49ee', 'volume_name': 'volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16bb7842-698f-4880-b607-5cc85da2c0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16bb7842-698f-4880-b607-5cc85da2c0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6c2431-3605-4c0a-b283-b1b4b2ab00c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:46 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume 2463eb9e-ff65-42a6-8a65-f8865a7e49ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee', 'volume_size': 1} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c70adc7-850a-4d76-8aa4-c17bacbcbecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd40848a-71b4-479c-b289-7cb35f282d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:46 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8 (dc9ebf4f-6048-42a1-8b3f-918c014b4cc8): created successfully Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd40848a-71b4-479c-b289-7cb35f282d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Flow 'volume_create_manager' (57682be2-cafd-494e-88f7-c114135a511f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:46 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-432cb7b9-bb0e-432a-b4ef-cc3ee0b370dc tempest-CreateVolumesFromSnapshotTest-129904273 None] Created volume successfully. Jun 28 14:30:47 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7 1073741824" returned: 0 in 1.122s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:47 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7 Jun 28 14:30:47 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:48 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7" returned: 0 in 0.867s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.131s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1860350222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d02a29-7c57-471c-b687-f8034a8cf309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a48a91a4f3645fba4836d1c81673614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:45Z,use_quota=True,user_id='36cd51cebd3f4376acb5ed38c47cdc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Creating volume 07d02a29-7c57-471c-b687-f8034a8cf309 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:30:48 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-07d02a29-7c57-471c-b687-f8034a8cf309 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e291cfe-7650-4eff-96bd-b787f4c37ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ca9d87-e10e-4987-9b8c-3d1f19708df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:48 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-07d02a29-7c57-471c-b687-f8034a8cf309 1073741824 Jun 28 14:30:48 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:48 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7 (98f0dc56-6cc8-422b-9b1f-aa104451e4e7): created successfully Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ca9d87-e10e-4987-9b8c-3d1f19708df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Flow 'volume_create_manager' (8110e596-fac1-4e0f-9dd9-7fe6b30f121b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:48 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-40df819a-c748-4956-934e-a98907c1dac8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Created volume successfully. Jun 28 14:30:49 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-07d02a29-7c57-471c-b687-f8034a8cf309 1073741824" returned: 0 in 1.046s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-07d02a29-7c57-471c-b687-f8034a8cf309 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:49 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-07d02a29-7c57-471c-b687-f8034a8cf309 Jun 28 14:30:49 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:50 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-07d02a29-7c57-471c-b687-f8034a8cf309" returned: 0 in 0.887s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.545s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-911062345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2702158e-5d43-4b35-a072-5c14423e0e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a48a91a4f3645fba4836d1c81673614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:46Z,use_quota=True,user_id='36cd51cebd3f4376acb5ed38c47cdc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Creating volume 2702158e-5d43-4b35-a072-5c14423e0e27 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:30:50 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2702158e-5d43-4b35-a072-5c14423e0e27 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:50 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2702158e-5d43-4b35-a072-5c14423e0e27 1073741824 Jun 28 14:30:50 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f637b5b1-7b07-4bf9-9c59-79151ed9177d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07d02a29-7c57-471c-b687-f8034a8cf309', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c40cb04-f0ac-4da4-8ef7-f16d3a1f21ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:50 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume volume-07d02a29-7c57-471c-b687-f8034a8cf309 (07d02a29-7c57-471c-b687-f8034a8cf309): created successfully Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c40cb04-f0ac-4da4-8ef7-f16d3a1f21ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Flow 'volume_create_manager' (ace13083-b6ba-4d74-84c8-ba9e409f2f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:50 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e8b7be32-fc71-461b-bbf8-b3c808e5cf10 tempest-CreateVolumesFromSnapshotTest-129904273 None] Created volume successfully. Jun 28 14:30:51 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2702158e-5d43-4b35-a072-5c14423e0e27 1073741824" returned: 0 in 1.102s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2702158e-5d43-4b35-a072-5c14423e0e27 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:51 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2702158e-5d43-4b35-a072-5c14423e0e27 Jun 28 14:30:51 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:52 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-e5fe7e57-afed-4fa8-8dc6-535d91615e5f req-5454a251-3b16-474c-bd62-ffb659e46aea tempest-AttachVolumeTestJSON-144543565 None] Terminate volume connection completed successfully. Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e5fe7e57-afed-4fa8-8dc6-535d91615e5f req-5454a251-3b16-474c-bd62-ffb659e46aea tempest-AttachVolumeTestJSON-144543565 None] Deleting attachment 91380ae5-9af8-48e8-aeb8-94258d960e12. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:30:52 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2702158e-5d43-4b35-a072-5c14423e0e27" returned: 0 in 0.972s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.152s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-530293941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2463eb9e-ff65-42a6-8a65-f8865a7e49ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a48a91a4f3645fba4836d1c81673614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:46Z,use_quota=True,user_id='36cd51cebd3f4376acb5ed38c47cdc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Creating volume 2463eb9e-ff65-42a6-8a65-f8865a7e49ee {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:30:52 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:52 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee 1073741824 Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a91ba78-8613-434b-9207-91c06ff58c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2702158e-5d43-4b35-a072-5c14423e0e27', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:52 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256f9925-2cb6-484e-bb94-1a421c800243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:52 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume volume-2702158e-5d43-4b35-a072-5c14423e0e27 (2702158e-5d43-4b35-a072-5c14423e0e27): created successfully Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256f9925-2cb6-484e-bb94-1a421c800243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Flow 'volume_create_manager' (0407c0ab-7db4-42fa-beaa-abf795e2473e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:52 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-d906657c-c295-44cc-a9a6-52e3cff52d03 tempest-CreateVolumesFromSnapshotTest-129904273 None] Created volume successfully. Jun 28 14:30:53 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee 1073741824" returned: 0 in 1.091s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:53 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee Jun 28 14:30:53 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:54 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee" returned: 0 in 0.866s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:54 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:30:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6c2431-3605-4c0a-b283-b1b4b2ab00c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a92fefa9-7c79-4f20-90d9-00bd7ba09ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:54 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Volume volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee (2463eb9e-ff65-42a6-8a65-f8865a7e49ee): created successfully Jun 28 14:30:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a92fefa9-7c79-4f20-90d9-00bd7ba09ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Flow 'volume_create_manager' (5eab2a5c-89df-4558-829a-6e6cfc3922e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:54 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-439acc6f-cb40-438e-8ed8-8d5c52d59ab9 tempest-CreateVolumesFromSnapshotTest-129904273 None] Created volume successfully. Jun 28 14:30:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "cinder-2463eb9e-ff65-42a6-8a65-f8865a7e49ee-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-2463eb9e-ff65-42a6-8a65-f8865a7e49ee-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "cinder-quobyte-2463eb9e-ff65-42a6-8a65-f8865a7e49ee" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-2463eb9e-ff65-42a6-8a65-f8865a7e49ee" acquired by "delete_volume" :: waited 0.032s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:55 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f4a207-dfa1-4e1f-8948-4435dc0d5efc]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:55 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee Jun 28 14:30:55 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:56 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-6651bd4a-4ed0-4596-91fd-0c676187b4d1 req-3b7245e7-de00-4d9a-9778-f17571763d17 tempest-AttachVolumeTestJSON-144543565 None] Terminate volume connection completed successfully. Jun 28 14:30:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-6651bd4a-4ed0-4596-91fd-0c676187b4d1 req-3b7245e7-de00-4d9a-9778-f17571763d17 tempest-AttachVolumeTestJSON-144543565 None] Deleting attachment 97d3c7a5-1633-445e-8127-30241378102b. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:30:56 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee" returned: 0 in 1.042s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:56 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee Jun 28 14:30:56 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:57 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2463eb9e-ff65-42a6-8a65-f8865a7e49ee" returned: 0 in 0.749s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-2463eb9e-ff65-42a6-8a65-f8865a7e49ee" released by "delete_volume" :: held 1.871s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Created reservations ['1e06c163-1bc3-46d7-8dac-fd3d99d8c293', 'a5f360e0-2be4-469b-abbf-3d7f61525c6d', 'bbff7932-dde9-4f30-8ceb-195c62691608', '4f3c8cde-66d5-4a1f-b942-a7e79b6dc50e'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Flow 'volume_create_manager' (f623f86f-7cba-474f-ae60-3059b582d36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a0bb92-6c1c-4b1e-ae0c-d606fffc4697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a0bb92-6c1c-4b1e-ae0c-d606fffc4697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1351640113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de158e0-90aa-4b0d-bebc-7248a40545ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a059ca2da36f41df84e730e1173a1c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:58Z,use_quota=True,user_id='f60047b4bab144a59fa39f9d2f598162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b049ef72-9f4c-42db-83a9-a394ab7db948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b049ef72-9f4c-42db-83a9-a394ab7db948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b50b37-642b-483f-8eba-8e0a04e6c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b50b37-642b-483f-8eba-8e0a04e6c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de158e0-90aa-4b0d-bebc-7248a40545ca', 'volume_name': 'volume-7de158e0-90aa-4b0d-bebc-7248a40545ca', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ddd7352-35a3-4127-b81b-ecf115e4f8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ddd7352-35a3-4127-b81b-ecf115e4f8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9155898-9037-46e4-b40e-901d4c92b35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:57 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Volume 7de158e0-90aa-4b0d-bebc-7248a40545ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de158e0-90aa-4b0d-bebc-7248a40545ca', 'volume_size': 1} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1351640113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de158e0-90aa-4b0d-bebc-7248a40545ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a059ca2da36f41df84e730e1173a1c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:30:58Z,use_quota=True,user_id='f60047b4bab144a59fa39f9d2f598162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Creating volume 7de158e0-90aa-4b0d-bebc-7248a40545ca {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:30:57 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7de158e0-90aa-4b0d-bebc-7248a40545ca 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:30:57 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7de158e0-90aa-4b0d-bebc-7248a40545ca 1073741824 Jun 28 14:30:57 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "cinder-2702158e-5d43-4b35-a072-5c14423e0e27-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-2702158e-5d43-4b35-a072-5c14423e0e27-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:57 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:30:57 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "cinder-quobyte-2702158e-5d43-4b35-a072-5c14423e0e27" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-2702158e-5d43-4b35-a072-5c14423e0e27" acquired by "delete_volume" :: waited 0.047s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa2847c-5164-43ab-8bd0-a33a22cbb2f8]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:30:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2702158e-5d43-4b35-a072-5c14423e0e27 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:58 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2702158e-5d43-4b35-a072-5c14423e0e27 Jun 28 14:30:58 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:58 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.824s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:58 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:30:58 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Deleted volume successfully. Jun 28 14:30:58 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1c92118f-1fa4-4f1c-b4db-88270b64b1c4 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-2463eb9e-ff65-42a6-8a65-f8865a7e49ee-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:59 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7de158e0-90aa-4b0d-bebc-7248a40545ca 1073741824" returned: 0 in 1.355s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7de158e0-90aa-4b0d-bebc-7248a40545ca {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:59 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2702158e-5d43-4b35-a072-5c14423e0e27" returned: 0 in 1.184s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2702158e-5d43-4b35-a072-5c14423e0e27 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:30:59 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7de158e0-90aa-4b0d-bebc-7248a40545ca Jun 28 14:30:59 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:59 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2702158e-5d43-4b35-a072-5c14423e0e27 Jun 28 14:30:59 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:30:59 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7de158e0-90aa-4b0d-bebc-7248a40545ca" returned: 0 in 0.697s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:59 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:30:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:30:59 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jun 28 14:30:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9155898-9037-46e4-b40e-901d4c92b35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de158e0-90aa-4b0d-bebc-7248a40545ca', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432b8b9e-84e4-42b9-9058-18cb97ab72c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:30:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2702158e-5d43-4b35-a072-5c14423e0e27" returned: 0 in 0.704s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:30:59 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Volume volume-7de158e0-90aa-4b0d-bebc-7248a40545ca (7de158e0-90aa-4b0d-bebc-7248a40545ca): created successfully Jun 28 14:30:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432b8b9e-84e4-42b9-9058-18cb97ab72c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:30:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Flow 'volume_create_manager' (f623f86f-7cba-474f-ae60-3059b582d36e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:30:59 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-2702158e-5d43-4b35-a072-5c14423e0e27" released by "delete_volume" :: held 1.959s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:30:59 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-63603a8a-5915-4c2a-a7d5-8ac284d4d615 tempest-VolumesMetadataTest-1378482522 None] Created volume successfully. Jun 28 14:31:00 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Created reservations ['abccabd0-5deb-4ac3-9666-f5da196c706d', '0a36010a-1b56-4262-8bb5-c612f3e60ca2', '0231211f-0500-4087-bf00-67f4887151a5', 'a80e23ce-e683-4494-ab7a-e6c583fb9786'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:00 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:00 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:00 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "cinder-07d02a29-7c57-471c-b687-f8034a8cf309-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:00 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-07d02a29-7c57-471c-b687-f8034a8cf309-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:00 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "cinder-quobyte-07d02a29-7c57-471c-b687-f8034a8cf309" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:00 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-07d02a29-7c57-471c-b687-f8034a8cf309" acquired by "delete_volume" :: waited 0.033s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:00 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba8a1b9-606d-4bfa-8d84-0afd9e119337]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-07d02a29-7c57-471c-b687-f8034a8cf309 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:00 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-07d02a29-7c57-471c-b687-f8034a8cf309 Jun 28 14:31:00 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:01 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.922s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:01 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:01 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Deleted volume successfully. Jun 28 14:31:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e8b8af03-2270-46f6-8d1a-5b2cad6064bf tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-2702158e-5d43-4b35-a072-5c14423e0e27-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:01 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-07d02a29-7c57-471c-b687-f8034a8cf309" returned: 0 in 1.118s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-07d02a29-7c57-471c-b687-f8034a8cf309 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:01 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-07d02a29-7c57-471c-b687-f8034a8cf309 Jun 28 14:31:01 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Acquiring lock "cinder-7de158e0-90aa-4b0d-bebc-7248a40545ca-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Lock "cinder-7de158e0-90aa-4b0d-bebc-7248a40545ca-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Acquiring lock "cinder-quobyte-7de158e0-90aa-4b0d-bebc-7248a40545ca" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:02 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Lock "cinder-quobyte-7de158e0-90aa-4b0d-bebc-7248a40545ca" acquired by "delete_volume" :: waited 0.041s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:02 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4cb3a3-321a-45f0-831d-eae3c2935fcd]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7de158e0-90aa-4b0d-bebc-7248a40545ca {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:02 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7de158e0-90aa-4b0d-bebc-7248a40545ca Jun 28 14:31:02 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:02 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-07d02a29-7c57-471c-b687-f8034a8cf309" returned: 0 in 1.098s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:02 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-07d02a29-7c57-471c-b687-f8034a8cf309" released by "delete_volume" :: held 2.282s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:02 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Created reservations ['1fb3db42-5c1d-4bf8-a78d-bd9d326e3e4d', 'c506811a-66e6-45ee-8279-06e73aa22f82', 'fd703e3c-1f98-48f6-b08c-4f4ac60cc8b9', '2f4117c5-45fc-46f1-b03a-63bccef431aa'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:02 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:02 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:03 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7de158e0-90aa-4b0d-bebc-7248a40545ca" returned: 0 in 1.190s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7de158e0-90aa-4b0d-bebc-7248a40545ca {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:03 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7de158e0-90aa-4b0d-bebc-7248a40545ca Jun 28 14:31:03 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:03 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "cinder-98f0dc56-6cc8-422b-9b1f-aa104451e4e7-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:03 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-98f0dc56-6cc8-422b-9b1f-aa104451e4e7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:03 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.919s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:03 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:03 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Deleted volume successfully. Jun 28 14:31:03 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c5447097-cf70-4456-a270-f52aa54d1228 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-07d02a29-7c57-471c-b687-f8034a8cf309-delete_volume" released by "delete_volume" :: held 3.592s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:03 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "cinder-quobyte-98f0dc56-6cc8-422b-9b1f-aa104451e4e7" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:03 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-98f0dc56-6cc8-422b-9b1f-aa104451e4e7" acquired by "delete_volume" :: waited 0.024s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:03 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1a85da-6c7e-457d-abe9-9a71f9184d6f]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:04 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7 Jun 28 14:31:04 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:04 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7de158e0-90aa-4b0d-bebc-7248a40545ca" returned: 0 in 1.125s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:04 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Lock "cinder-quobyte-7de158e0-90aa-4b0d-bebc-7248a40545ca" released by "delete_volume" :: held 2.380s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:04 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Created reservations ['5a82c191-6611-4cd4-b781-0860e38cd4f7', 'baf396bf-1bca-4230-9fc1-a905c6d8b3b4', '7fd390eb-250a-4af3-9d2e-695aa3b9c41b', 'c313539c-d54f-486c-8708-7ae3c26c3a3b'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:04 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:04 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:05 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7" returned: 0 in 1.146s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:05 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7 Jun 28 14:31:05 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:05 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.781s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:05 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:05 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Deleted volume successfully. Jun 28 14:31:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-374aee8a-51eb-40e1-bb2c-8b2d1e71fed0 tempest-VolumesMetadataTest-1378482522 None] Lock "cinder-7de158e0-90aa-4b0d-bebc-7248a40545ca-delete_volume" released by "delete_volume" :: held 3.545s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:05 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-98f0dc56-6cc8-422b-9b1f-aa104451e4e7" returned: 0 in 0.714s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-98f0dc56-6cc8-422b-9b1f-aa104451e4e7" released by "delete_volume" :: held 1.933s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:05 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Created reservations ['a3482bca-9c66-4c76-8efa-11d40889b900', '73e25386-8e0b-45d8-9352-b54ea6bb9cbe', '76298242-d4ab-46a0-a46c-fb49b9ff605e', 'e81b668a-360b-4977-a70d-1559eb54dd92'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:06 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:06 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "cinder-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "cinder-quobyte-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8" acquired by "delete_volume" :: waited 0.028s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:06 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[68081e64-112d-47cd-b1ee-9caf662dab65]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:06 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8 Jun 28 14:31:06 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:06 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.921s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:06 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:06 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Deleted volume successfully. Jun 28 14:31:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b02c1ba9-438c-4839-832e-43183fed0555 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-98f0dc56-6cc8-422b-9b1f-aa104451e4e7-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:07 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8" returned: 0 in 1.192s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:07 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8 Jun 28 14:31:07 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:08 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8" returned: 0 in 0.828s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:08 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8" released by "delete_volume" :: held 2.096s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:08 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Created reservations ['737b353e-be4a-44a6-97c9-3a937199bba3', '32597ef0-075e-48c4-806d-6fc2a68f286e', '99e31e93-93d2-469d-abe2-46045512deba', 'b75edd60-6a45-43ab-81f9-51790f71f9a3'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:08 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:08 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "cinder-16187686-7661-483d-8836-b22ec205655b-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Lock "cinder-16187686-7661-483d-8836-b22ec205655b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "cinder-quobyte-16187686-7661-483d-8836-b22ec205655b" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Lock "cinder-quobyte-16187686-7661-483d-8836-b22ec205655b" acquired by "delete_volume" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c2e206-e230-4081-95fb-dca4e180bfe1]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16187686-7661-483d-8836-b22ec205655b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:09 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16187686-7661-483d-8836-b22ec205655b Jun 28 14:31:09 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:09 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.988s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "cinder-926979e8-8402-406a-9c6e-1b16db11065e-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:09 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Deleted volume successfully. Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-926979e8-8402-406a-9c6e-1b16db11065e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "cinder-quobyte-92dd891c-6d89-473c-bf00-3dc28fa2644b" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7035019c-f3ec-4b14-a49d-170466c2dea8 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-dc9ebf4f-6048-42a1-8b3f-918c014b4cc8-delete_volume" released by "delete_volume" :: held 3.481s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-92dd891c-6d89-473c-bf00-3dc28fa2644b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "cinder-quobyte-926979e8-8402-406a-9c6e-1b16db11065e" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-926979e8-8402-406a-9c6e-1b16db11065e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Deleting offline snapshot 926979e8-8402-406a-9c6e-1b16db11065e of volume 92dd891c-6d89-473c-bf00-3dc28fa2644b {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] snapshot_file for this snap is: volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[942db104-c7d3-4209-97fd-10beb9565440]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:09 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e Jun 28 14:31:09 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:10 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16187686-7661-483d-8836-b22ec205655b" returned: 0 in 1.133s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16187686-7661-483d-8836-b22ec205655b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:10 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16187686-7661-483d-8836-b22ec205655b Jun 28 14:31:10 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:10 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e" returned: 0 in 1.171s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:10 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92dd891c-6d89-473c-bf00-3dc28fa2644b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:31:10 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3abf67-c38a-4b82-87e0-f7c945357609]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:11 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b Jun 28 14:31:11 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:11 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16187686-7661-483d-8836-b22ec205655b" returned: 0 in 0.815s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Lock "cinder-quobyte-16187686-7661-483d-8836-b22ec205655b" released by "delete_volume" :: held 2.014s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:11 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Created reservations ['e6663d93-0101-457d-a887-06d7b05169c3', '1bcb680a-c1c7-4c92-811c-55a0917fafa0', '450df19c-626b-4cb8-9dbd-b5d176c4a866', '23d7a45e-5f74-48df-8c88-1d06f498be39'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:11 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:11 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "cinder-147aeb45-7144-43c4-bf29-ee3d779e54c0-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Lock "cinder-147aeb45-7144-43c4-bf29-ee3d779e54c0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "cinder-quobyte-147aeb45-7144-43c4-bf29-ee3d779e54c0" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Lock "cinder-quobyte-147aeb45-7144-43c4-bf29-ee3d779e54c0" acquired by "delete_volume" :: waited 0.038s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:11 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce8a471-5288-40ed-933a-76e7999f21c6]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-147aeb45-7144-43c4-bf29-ee3d779e54c0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:11 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-147aeb45-7144-43c4-bf29-ee3d779e54c0 Jun 28 14:31:11 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:12 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b" returned: 0 in 1.155s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:12 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e Jun 28 14:31:12 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.952s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:12 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:12 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:12 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Deleted volume successfully. Jun 28 14:31:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-196d361b-b933-423d-ae7c-7cc717e8cd7f tempest-AttachVolumeTestJSON-144543565 None] Lock "cinder-16187686-7661-483d-8836-b22ec205655b-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:12 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-147aeb45-7144-43c4-bf29-ee3d779e54c0" returned: 0 in 1.222s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-147aeb45-7144-43c4-bf29-ee3d779e54c0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:12 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-147aeb45-7144-43c4-bf29-ee3d779e54c0 Jun 28 14:31:12 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:13 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e" returned: 0 in 1.209s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:13 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e Jun 28 14:31:13 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:13 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-147aeb45-7144-43c4-bf29-ee3d779e54c0" returned: 0 in 0.892s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Lock "cinder-quobyte-147aeb45-7144-43c4-bf29-ee3d779e54c0" released by "delete_volume" :: held 2.228s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:13 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Created reservations ['fd124041-5e20-42b5-bc93-931ff61aa7f8', 'e181e6f2-fc7f-4c9c-bea9-989db01d7a34', '8c633920-1c9d-4e3e-8273-c17dfa327e83', '38bca21a-50ed-4f20-bd55-13a244af8e7d'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:14 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:14 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:14 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b.926979e8-8402-406a-9c6e-1b16db11065e" returned: 0 in 0.863s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-926979e8-8402-406a-9c6e-1b16db11065e" released by "_delete_snapshot" :: held 4.562s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-92dd891c-6d89-473c-bf00-3dc28fa2644b" released by "delete_snapshot" :: held 4.589s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Created reservations ['f7b213fa-3557-4a08-9111-36afafc5f06f', 'cef6af67-de84-4a08-8190-eea624485667', 'cac9e28e-996c-43ae-a91b-0fdcb18f3ef3', 'fcfad2c9-8d80-4d9a-86e2-67f994811af1'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:14 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Delete snapshot completed successfully. Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-178d7e99-675f-4ff1-bd07-7b39c59d77eb tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-926979e8-8402-406a-9c6e-1b16db11065e-delete_snapshot" released by "delete_snapshot" :: held 4.789s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:14 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.748s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:14 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Deleted volume successfully. Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6bfec8e1-d3b6-4dc6-90d6-6c6c7fee59cc tempest-AttachVolumeTestJSON-144543565 None] Lock "cinder-147aeb45-7144-43c4-bf29-ee3d779e54c0-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "cinder-92dd891c-6d89-473c-bf00-3dc28fa2644b-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-92dd891c-6d89-473c-bf00-3dc28fa2644b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:14 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "cinder-quobyte-92dd891c-6d89-473c-bf00-3dc28fa2644b" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-92dd891c-6d89-473c-bf00-3dc28fa2644b" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:15 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0e5b6b-3f6c-43e5-ac73-0e588aab0151]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:15 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b Jun 28 14:31:15 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "cinder-6d0966e3-31b6-455e-babd-dd6fa2f8664a-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Lock "cinder-6d0966e3-31b6-455e-babd-dd6fa2f8664a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "cinder-quobyte-6d0966e3-31b6-455e-babd-dd6fa2f8664a" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Lock "cinder-quobyte-6d0966e3-31b6-455e-babd-dd6fa2f8664a" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:15 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e414e408-80a1-480a-b954-19adbeb3920d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:15 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a Jun 28 14:31:15 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:16 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b" returned: 0 in 1.203s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:16 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b Jun 28 14:31:16 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:16 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a" returned: 0 in 0.928s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:16 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a Jun 28 14:31:16 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:17 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6d0966e3-31b6-455e-babd-dd6fa2f8664a" returned: 0 in 0.745s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Lock "cinder-quobyte-6d0966e3-31b6-455e-babd-dd6fa2f8664a" released by "delete_volume" :: held 1.746s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:17 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-92dd891c-6d89-473c-bf00-3dc28fa2644b" returned: 0 in 0.965s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-quobyte-92dd891c-6d89-473c-bf00-3dc28fa2644b" released by "delete_volume" :: held 2.255s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Created reservations ['b4071194-4f8c-4aef-9dbb-41e0b007b4ae', '01336db8-e6b8-468d-9177-fc23cbe9ea6c', 'e1c709b8-a524-4814-83e9-e7ab23090ed2', '591ea976-03ad-4fd1-b0a1-4299eb9e92ad'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Created reservations ['e03fd60e-4ecf-4c4c-a361-0b582eeba6c1', 'e21db9d4-c665-4263-b174-4fc57b8cfee5', 'd8f9b4f5-4f1b-44ec-85ca-5506728b0fb5', 'c29fcdd2-515c-4360-9b83-627e5f11c42b'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:17 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:17 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:17 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:17 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:18 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.852s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:18 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:18 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Deleted volume successfully. Jun 28 14:31:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a0173b3f-bd86-4aff-b9f5-787a3af2cb07 tempest-CreateVolumesFromSnapshotTest-129904273 None] Lock "cinder-92dd891c-6d89-473c-bf00-3dc28fa2644b-delete_volume" released by "delete_volume" :: held 3.478s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:18 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.054s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:18 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:18 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Deleted volume successfully. Jun 28 14:31:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f0cdfc54-53a8-46ab-b6e4-34d36a947f41 tempest-AttachVolumeTestJSON-144543565 None] Lock "cinder-6d0966e3-31b6-455e-babd-dd6fa2f8664a-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Flow 'volume_create_manager' (feba5ae1-d4d3-4409-a1e6-22372d3d6e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ff2591-e900-41d9-8242-ea34e6dda447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ff2591-e900-41d9-8242-ea34e6dda447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651940911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cf8e25-b72e-41f7-9de4-3668d825fa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be74da0bf242248ba10b33d3ef786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:25Z,use_quota=True,user_id='20140ea3f9164a989e32ba2d7a1e2004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1940b696-1e0e-40be-b5d2-c2aa85ccb73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1940b696-1e0e-40be-b5d2-c2aa85ccb73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345f860b-2aab-44de-8227-fbddd2eae08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345f860b-2aab-44de-8227-fbddd2eae08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93cf8e25-b72e-41f7-9de4-3668d825fa63', 'volume_name': 'volume-93cf8e25-b72e-41f7-9de4-3668d825fa63', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5e3c6c-467a-4471-8a1c-18bae2f4f73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5e3c6c-467a-4471-8a1c-18bae2f4f73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46aa137d-9d88-4498-9388-b998374403a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:24 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume 93cf8e25-b72e-41f7-9de4-3668d825fa63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93cf8e25-b72e-41f7-9de4-3668d825fa63', 'volume_size': 1} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651940911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cf8e25-b72e-41f7-9de4-3668d825fa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be74da0bf242248ba10b33d3ef786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:25Z,use_quota=True,user_id='20140ea3f9164a989e32ba2d7a1e2004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Creating volume 93cf8e25-b72e-41f7-9de4-3668d825fa63 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:31:24 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-93cf8e25-b72e-41f7-9de4-3668d825fa63 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:24 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-93cf8e25-b72e-41f7-9de4-3668d825fa63 1073741824 Jun 28 14:31:24 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Flow 'volume_create_manager' (7f1c7da3-8ffe-4a29-9b36-1f2bc3e4c895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabcc46b-d93e-4c86-831f-533d62ae7fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabcc46b-d93e-4c86-831f-533d62ae7fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1116146410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad2dc66-748f-4b8b-9876-e58e40f86de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f049f29a4d4600a1aa9edb38a637eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:25Z,use_quota=True,user_id='4aff54a0fc5e4483b1d0300837edae5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59dd2d7-e854-492a-aeec-d2d5d8fb4709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59dd2d7-e854-492a-aeec-d2d5d8fb4709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50144c5-2d4c-4ab6-a44c-787002b3bdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50144c5-2d4c-4ab6-a44c-787002b3bdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ad2dc66-748f-4b8b-9876-e58e40f86de2', 'volume_name': 'volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9016a667-5f1f-4407-8b20-ae98fdacc848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9016a667-5f1f-4407-8b20-ae98fdacc848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862d3af6-198b-498b-af76-919d7235d810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:24 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Volume 8ad2dc66-748f-4b8b-9876-e58e40f86de2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2', 'volume_size': 1} Jun 28 14:31:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:25 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-93cf8e25-b72e-41f7-9de4-3668d825fa63 1073741824" returned: 0 in 0.955s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-93cf8e25-b72e-41f7-9de4-3668d825fa63 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:25 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-93cf8e25-b72e-41f7-9de4-3668d825fa63 Jun 28 14:31:25 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:26 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-93cf8e25-b72e-41f7-9de4-3668d825fa63" returned: 0 in 0.688s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.536s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1116146410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad2dc66-748f-4b8b-9876-e58e40f86de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f049f29a4d4600a1aa9edb38a637eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:25Z,use_quota=True,user_id='4aff54a0fc5e4483b1d0300837edae5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Creating volume 8ad2dc66-748f-4b8b-9876-e58e40f86de2 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:31:26 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:26 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 1073741824 Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46aa137d-9d88-4498-9388-b998374403a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93cf8e25-b72e-41f7-9de4-3668d825fa63', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:26 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1c4341-f1d4-4e70-802e-32932da09908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:26 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume volume-93cf8e25-b72e-41f7-9de4-3668d825fa63 (93cf8e25-b72e-41f7-9de4-3668d825fa63): created successfully Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1c4341-f1d4-4e70-802e-32932da09908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Flow 'volume_create_manager' (feba5ae1-d4d3-4409-a1e6-22372d3d6e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:26 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-cb62ea9a-5fdc-4ea0-bac7-45e97b3dd595 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Created volume successfully. Jun 28 14:31:27 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:31:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Flow 'volume_create_manager' (dfaa9847-d8f7-43b7-9af6-27c110ae1b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a23cda-3cdb-449e-af2a-99af521facee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a23cda-3cdb-449e-af2a-99af521facee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-701336706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1001f3fa-4dba-4ef3-a398-4c6656b64054,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d48bbb2568d9401882d7e3cfe7c0771e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:27Z,use_quota=True,user_id='7fbdcb7cb0a54c05ba8e0ca9f4c5e7a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a28e3c-a0ae-4129-a2cb-b3cc006a3c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a28e3c-a0ae-4129-a2cb-b3cc006a3c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51a2658-6bde-48a3-beee-a0b828b20487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51a2658-6bde-48a3-beee-a0b828b20487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1001f3fa-4dba-4ef3-a398-4c6656b64054', 'volume_name': 'volume-1001f3fa-4dba-4ef3-a398-4c6656b64054', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531c1575-89ca-4e65-9196-956f4d7c571e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531c1575-89ca-4e65-9196-956f4d7c571e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a216c7-37f7-449b-a544-2373be45d78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:27 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Volume 1001f3fa-4dba-4ef3-a398-4c6656b64054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1001f3fa-4dba-4ef3-a398-4c6656b64054', 'volume_size': 1} Jun 28 14:31:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:27 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 1073741824" returned: 0 in 0.883s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:27 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 Jun 28 14:31:27 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=114,cinder:INSERT=34,cinder:UPDATE=144,cinder:DELETE=8 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=107,cinder:UPDATE=148,cinder:INSERT=37,cinder:DELETE=14 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Flow 'volume_create_manager' (747fb643-3c1e-4ae3-a25e-163d190028d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf32f5e-a453-418b-82ef-287fa1ea3e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf32f5e-a453-418b-82ef-287fa1ea3e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400233057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae747cab-4427-4835-b73e-f0d0b9abcd17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be74da0bf242248ba10b33d3ef786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:28Z,use_quota=True,user_id='20140ea3f9164a989e32ba2d7a1e2004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:28 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276f3fe5-8c86-4dbc-b741-ee4927fc879b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276f3fe5-8c86-4dbc-b741-ee4927fc879b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b19fc61-5864-4784-b674-c74cf186b886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b19fc61-5864-4784-b674-c74cf186b886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae747cab-4427-4835-b73e-f0d0b9abcd17', 'volume_name': 'volume-ae747cab-4427-4835-b73e-f0d0b9abcd17', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24df22d8-43fe-4c1c-ae85-36a056228871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24df22d8-43fe-4c1c-ae85-36a056228871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a1cf46-5dc4-4f7f-9c40-03f5e28220c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:28 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume ae747cab-4427-4835-b73e-f0d0b9abcd17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae747cab-4427-4835-b73e-f0d0b9abcd17', 'volume_size': 1} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2" returned: 0 in 0.921s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.965s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-701336706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1001f3fa-4dba-4ef3-a398-4c6656b64054,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d48bbb2568d9401882d7e3cfe7c0771e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:27Z,use_quota=True,user_id='7fbdcb7cb0a54c05ba8e0ca9f4c5e7a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Creating volume 1001f3fa-4dba-4ef3-a398-4c6656b64054 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:31:28 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1001f3fa-4dba-4ef3-a398-4c6656b64054 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862d3af6-198b-498b-af76-919d7235d810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:28 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1001f3fa-4dba-4ef3-a398-4c6656b64054 1073741824 Jun 28 14:31:28 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d31a301-069c-45b9-bf8e-3d3853ce4e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:28 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Volume volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 (8ad2dc66-748f-4b8b-9876-e58e40f86de2): created successfully Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d31a301-069c-45b9-bf8e-3d3853ce4e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Flow 'volume_create_manager' (7f1c7da3-8ffe-4a29-9b36-1f2bc3e4c895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:28 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-41d22218-d66a-497d-9322-1d5fa4cd60a2 tempest-VolumesActionsTest-1814209699 None] Created volume successfully. Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Flow 'volume_create_manager' (28b6ed66-ef22-416f-bbdd-d49274dc0b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22085ddb-5f4a-48ca-a49d-0fa91fa726ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22085ddb-5f4a-48ca-a49d-0fa91fa726ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1360154923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6fd4bf-32d0-4775-8676-e6ab9f7cf89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be74da0bf242248ba10b33d3ef786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:29Z,use_quota=True,user_id='20140ea3f9164a989e32ba2d7a1e2004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04abda85-ffc4-40ff-a93b-73efaa2d9a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04abda85-ffc4-40ff-a93b-73efaa2d9a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c471a660-e93e-43ba-8f9b-63f2d846d9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c471a660-e93e-43ba-8f9b-63f2d846d9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df6fd4bf-32d0-4775-8676-e6ab9f7cf89c', 'volume_name': 'volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4713425e-110b-4d39-aad8-7983063d0896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4713425e-110b-4d39-aad8-7983063d0896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73c559a-b469-4c2f-9b27-b0d40cb99ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:29 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume df6fd4bf-32d0-4775-8676-e6ab9f7cf89c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c', 'volume_size': 1} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Flow 'volume_create_manager' (ac404fe0-15f0-4ac5-8c48-7c5b082c1b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b105a1c7-1f47-4c84-b34f-854789b18bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b105a1c7-1f47-4c84-b34f-854789b18bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-203936973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0295e5c9-c8b4-46ef-b232-2a330a9ae6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be74da0bf242248ba10b33d3ef786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:29Z,use_quota=True,user_id='20140ea3f9164a989e32ba2d7a1e2004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0753eaed-5425-4993-bf80-89d3cf2cfbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0753eaed-5425-4993-bf80-89d3cf2cfbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b25ae4-f67f-4f08-8f06-e6fdf42e7a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b25ae4-f67f-4f08-8f06-e6fdf42e7a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0295e5c9-c8b4-46ef-b232-2a330a9ae6a3', 'volume_name': 'volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46e3300-25da-48b4-999c-08196e4649f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46e3300-25da-48b4-999c-08196e4649f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd3526b-7482-4173-bfe8-c9cfbace2146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:29 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume 0295e5c9-c8b4-46ef-b232-2a330a9ae6a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3', 'volume_size': 1} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:29 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1001f3fa-4dba-4ef3-a398-4c6656b64054 1073741824" returned: 0 in 1.380s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1001f3fa-4dba-4ef3-a398-4c6656b64054 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:29 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1001f3fa-4dba-4ef3-a398-4c6656b64054 Jun 28 14:31:29 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Flow 'volume_create_manager' (bb229777-eda4-4a32-94ad-017dd0a107a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7088de-1d79-4c3f-b829-3f51f76d32ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7088de-1d79-4c3f-b829-3f51f76d32ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1255340216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75f4f26-9d46-40ad-950a-a1144b0090a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be74da0bf242248ba10b33d3ef786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:30Z,use_quota=True,user_id='20140ea3f9164a989e32ba2d7a1e2004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2658af58-c28d-4a7b-a31c-d6d4382a8f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2658af58-c28d-4a7b-a31c-d6d4382a8f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616e9835-30a0-4d2c-a0be-d9316495620a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616e9835-30a0-4d2c-a0be-d9316495620a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75f4f26-9d46-40ad-950a-a1144b0090a0', 'volume_name': 'volume-f75f4f26-9d46-40ad-950a-a1144b0090a0', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74627f0a-49dd-4d0f-9b3e-2e702ca12cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74627f0a-49dd-4d0f-9b3e-2e702ca12cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5a6da1-11fe-4b8e-a10d-ac2a7949b8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:30 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume f75f4f26-9d46-40ad-950a-a1144b0090a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75f4f26-9d46-40ad-950a-a1144b0090a0', 'volume_size': 1} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Flow 'volume_create_manager' (2a16e3e7-0fbf-4281-a87b-ab883f76bc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f419dde5-c5ce-410c-9e33-4451c70d1ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f419dde5-c5ce-410c-9e33-4451c70d1ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-690705827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f72d516b-6ca2-47ca-9ee1-c7fb451596da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be74da0bf242248ba10b33d3ef786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:31Z,use_quota=True,user_id='20140ea3f9164a989e32ba2d7a1e2004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bb6548-feb5-45a3-af06-5c8652ed0b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bb6548-feb5-45a3-af06-5c8652ed0b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebac7545-5f35-4011-9add-950dea50e546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebac7545-5f35-4011-9add-950dea50e546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f72d516b-6ca2-47ca-9ee1-c7fb451596da', 'volume_name': 'volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1206a6fc-a0b4-4dbc-829d-98b10e415531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1206a6fc-a0b4-4dbc-829d-98b10e415531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2dda17-1fcb-4448-8950-253fedeecbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:30 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume f72d516b-6ca2-47ca-9ee1-c7fb451596da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da', 'volume_size': 1} Jun 28 14:31:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:31 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1001f3fa-4dba-4ef3-a398-4c6656b64054" returned: 0 in 1.432s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] <== create_volume: return (2871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.874s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.886s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400233057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae747cab-4427-4835-b73e-f0d0b9abcd17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be74da0bf242248ba10b33d3ef786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:28Z,use_quota=True,user_id='20140ea3f9164a989e32ba2d7a1e2004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Creating volume ae747cab-4427-4835-b73e-f0d0b9abcd17 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:31:31 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ae747cab-4427-4835-b73e-f0d0b9abcd17 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:31 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ae747cab-4427-4835-b73e-f0d0b9abcd17 1073741824 Jun 28 14:31:31 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a216c7-37f7-449b-a544-2373be45d78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1001f3fa-4dba-4ef3-a398-4c6656b64054', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbfc961-bcde-4968-9348-4abd506a4676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:31 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Volume volume-1001f3fa-4dba-4ef3-a398-4c6656b64054 (1001f3fa-4dba-4ef3-a398-4c6656b64054): created successfully Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbfc961-bcde-4968-9348-4abd506a4676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Flow 'volume_create_manager' (dfaa9847-d8f7-43b7-9af6-27c110ae1b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:31 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a5204005-c90d-4173-a497-ce3e825cfd87 tempest-VolumesTestJSON-1513759991 None] Created volume successfully. Jun 28 14:31:32 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ae747cab-4427-4835-b73e-f0d0b9abcd17 1073741824" returned: 0 in 1.357s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:32 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:31:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Flow 'volume_create_manager' (4c006fde-3130-445c-a6e6-29eb9a613378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57709e8c-6a59-4c12-b94c-458b7fe2d3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57709e8c-6a59-4c12-b94c-458b7fe2d3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-447188843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d48bbb2568d9401882d7e3cfe7c0771e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:33Z,use_quota=True,user_id='7fbdcb7cb0a54c05ba8e0ca9f4c5e7a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8bce3e-7d22-489a-9b26-d0b236843986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8bce3e-7d22-489a-9b26-d0b236843986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3fbd596-3988-4805-a4c4-838df37a0024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3fbd596-3988-4805-a4c4-838df37a0024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9', 'volume_name': 'volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f33f1f-a583-4dfb-94b0-275762dbc263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f33f1f-a583-4dfb-94b0-275762dbc263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa2c207-cd73-43a7-b51d-d829c5d6aa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:32 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Volume ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9', 'volume_size': 1} Jun 28 14:31:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ae747cab-4427-4835-b73e-f0d0b9abcd17 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:32 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ae747cab-4427-4835-b73e-f0d0b9abcd17 Jun 28 14:31:32 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:33 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ae747cab-4427-4835-b73e-f0d0b9abcd17" returned: 0 in 0.677s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.169s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.379s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1360154923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6fd4bf-32d0-4775-8676-e6ab9f7cf89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be74da0bf242248ba10b33d3ef786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:29Z,use_quota=True,user_id='20140ea3f9164a989e32ba2d7a1e2004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Creating volume df6fd4bf-32d0-4775-8676-e6ab9f7cf89c {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:31:33 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a1cf46-5dc4-4f7f-9c40-03f5e28220c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae747cab-4427-4835-b73e-f0d0b9abcd17', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:33 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c 1073741824 Jun 28 14:31:33 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e24e6d-017d-42ad-81df-18897172f4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:33 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume volume-ae747cab-4427-4835-b73e-f0d0b9abcd17 (ae747cab-4427-4835-b73e-f0d0b9abcd17): created successfully Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e24e6d-017d-42ad-81df-18897172f4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Flow 'volume_create_manager' (747fb643-3c1e-4ae3-a25e-163d190028d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:33 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-5886c438-71b7-49a8-89bb-2a09d89325c2 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Created volume successfully. Jun 28 14:31:34 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c 1073741824" returned: 0 in 0.906s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:34 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c Jun 28 14:31:34 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:35 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c" returned: 0 in 0.681s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.631s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-203936973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0295e5c9-c8b4-46ef-b232-2a330a9ae6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be74da0bf242248ba10b33d3ef786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:29Z,use_quota=True,user_id='20140ea3f9164a989e32ba2d7a1e2004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Creating volume 0295e5c9-c8b4-46ef-b232-2a330a9ae6a3 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:31:35 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:35 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3 1073741824 Jun 28 14:31:35 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73c559a-b469-4c2f-9b27-b0d40cb99ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4269b0e-0b28-4c00-948d-29b4c3705e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:35 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c (df6fd4bf-32d0-4775-8676-e6ab9f7cf89c): created successfully Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4269b0e-0b28-4c00-948d-29b4c3705e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Flow 'volume_create_manager' (28b6ed66-ef22-416f-bbdd-d49274dc0b1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:35 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-26f7b221-a3c9-4675-bc2f-36ce579c78fe tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Created volume successfully. Jun 28 14:31:35 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3 1073741824" returned: 0 in 0.879s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:35 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3 Jun 28 14:31:35 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:36 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3" returned: 0 in 0.760s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.699s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1255340216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75f4f26-9d46-40ad-950a-a1144b0090a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be74da0bf242248ba10b33d3ef786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:30Z,use_quota=True,user_id='20140ea3f9164a989e32ba2d7a1e2004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Creating volume f75f4f26-9d46-40ad-950a-a1144b0090a0 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:31:36 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f75f4f26-9d46-40ad-950a-a1144b0090a0 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd3526b-7482-4173-bfe8-c9cfbace2146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead5da32-292c-4eaf-b7c7-6a60f427e60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:36 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f75f4f26-9d46-40ad-950a-a1144b0090a0 1073741824 Jun 28 14:31:36 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:36 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3 (0295e5c9-c8b4-46ef-b232-2a330a9ae6a3): created successfully Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead5da32-292c-4eaf-b7c7-6a60f427e60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Flow 'volume_create_manager' (ac404fe0-15f0-4ac5-8c48-7c5b082c1b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:36 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ac8de300-c724-4a91-8013-3d12e1e788ca tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Created volume successfully. Jun 28 14:31:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:31:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:37 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:37 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:37 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f75f4f26-9d46-40ad-950a-a1144b0090a0 1073741824" returned: 0 in 1.230s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f75f4f26-9d46-40ad-950a-a1144b0090a0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:38 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f75f4f26-9d46-40ad-950a-a1144b0090a0 Jun 28 14:31:38 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:39 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f75f4f26-9d46-40ad-950a-a1144b0090a0" returned: 0 in 1.456s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] <== create_volume: return (2781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.785s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.587s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-690705827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f72d516b-6ca2-47ca-9ee1-c7fb451596da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be74da0bf242248ba10b33d3ef786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:31Z,use_quota=True,user_id='20140ea3f9164a989e32ba2d7a1e2004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Creating volume f72d516b-6ca2-47ca-9ee1-c7fb451596da {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:31:39 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:39 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.756s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:39 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da 1073741824 Jun 28 14:31:39 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5a6da1-11fe-4b8e-a10d-ac2a7949b8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75f4f26-9d46-40ad-950a-a1144b0090a0', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b1edc3-e089-4e49-acae-9466b787e946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 8 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:31:39 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume volume-f75f4f26-9d46-40ad-950a-a1144b0090a0 (f75f4f26-9d46-40ad-950a-a1144b0090a0): created successfully Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b1edc3-e089-4e49-acae-9466b787e946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Flow 'volume_create_manager' (bb229777-eda4-4a32-94ad-017dd0a107a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:39 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ddc7d7e7-cc38-4f84-a568-854263d2c4d4 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Created volume successfully. Jun 28 14:31:40 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da 1073741824" returned: 0 in 0.960s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:40 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da Jun 28 14:31:40 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:41 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da" returned: 0 in 0.814s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.682s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-447188843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d48bbb2568d9401882d7e3cfe7c0771e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:33Z,use_quota=True,user_id='7fbdcb7cb0a54c05ba8e0ca9f4c5e7a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Creating volume ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:31:41 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2dda17-1fcb-4448-8950-253fedeecbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:41 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9 1073741824 Jun 28 14:31:41 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffa48da-fa24-4f57-8988-a037918b502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:41 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Volume volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da (f72d516b-6ca2-47ca-9ee1-c7fb451596da): created successfully Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffa48da-fa24-4f57-8988-a037918b502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Flow 'volume_create_manager' (2a16e3e7-0fbf-4281-a87b-ab883f76bc28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:41 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-059bb02c-40cd-40e1-b6ef-ebe32cc74129 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Created volume successfully. Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "cinder-f72d516b-6ca2-47ca-9ee1-c7fb451596da-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:41 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-f72d516b-6ca2-47ca-9ee1-c7fb451596da-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "cinder-quobyte-f72d516b-6ca2-47ca-9ee1-c7fb451596da" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-quobyte-f72d516b-6ca2-47ca-9ee1-c7fb451596da" acquired by "delete_volume" :: waited 0.034s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:42 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4067503a-c515-4476-ad89-b5613e24ae06]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:42 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da Jun 28 14:31:42 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:42 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9 1073741824" returned: 0 in 1.455s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:43 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9 Jun 28 14:31:43 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:43 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da" returned: 0 in 1.230s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:43 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da Jun 28 14:31:43 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:43 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9" returned: 0 in 0.854s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] <== create_volume: return (2417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:31:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.421s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa2c207-cd73-43a7-b51d-d829c5d6aa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f33ba7-bd86-4c63-a382-cb2180020651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:43 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Volume volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9 (ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9): created successfully Jun 28 14:31:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f33ba7-bd86-4c63-a382-cb2180020651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Flow 'volume_create_manager' (4c006fde-3130-445c-a6e6-29eb9a613378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:43 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-3bff7187-c7e1-4808-b5be-67b06972102a tempest-VolumesTestJSON-1513759991 None] Created volume successfully. Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Flow 'volume_create_manager' (01303517-1fb4-4d7d-b42b-b12236c3107f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190e4222-73a7-44d2-951e-505459ac2f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190e4222-73a7-44d2-951e-505459ac2f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1087717016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4a4245-2ec9-401f-a997-c0404a37be49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a51cfabd124c2bace24b0771519881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:44Z,use_quota=True,user_id='4d72c243976b4b578a1f2b480b036462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93119e4-ab76-4b10-920d-033a9dc4816c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93119e4-ab76-4b10-920d-033a9dc4816c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd757443-5b0e-4f17-a05f-f96bf731b69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd757443-5b0e-4f17-a05f-f96bf731b69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d4a4245-2ec9-401f-a997-c0404a37be49', 'volume_name': 'volume-9d4a4245-2ec9-401f-a997-c0404a37be49', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334db1f2-a91c-4ae4-8099-5abeb4b7430c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334db1f2-a91c-4ae4-8099-5abeb4b7430c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0acdf72-25bf-4783-8ed7-7d2360371de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:44 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Volume 9d4a4245-2ec9-401f-a997-c0404a37be49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d4a4245-2ec9-401f-a997-c0404a37be49', 'volume_size': 1} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1087717016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4a4245-2ec9-401f-a997-c0404a37be49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a51cfabd124c2bace24b0771519881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:44Z,use_quota=True,user_id='4d72c243976b4b578a1f2b480b036462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Creating volume 9d4a4245-2ec9-401f-a997-c0404a37be49 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:31:44 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9d4a4245-2ec9-401f-a997-c0404a37be49 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:44 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9d4a4245-2ec9-401f-a997-c0404a37be49 1073741824 Jun 28 14:31:44 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:44 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f72d516b-6ca2-47ca-9ee1-c7fb451596da" returned: 0 in 1.076s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-quobyte-f72d516b-6ca2-47ca-9ee1-c7fb451596da" released by "delete_volume" :: held 2.381s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Created reservations ['52860fee-3263-4466-ac76-f25c829a25b1', 'd74a06c7-37e8-4fa9-83b5-a3889111033c', '2569f13d-6179-4df1-9a45-9d488449595d', '383dda63-e1f3-4991-bb1d-f8384a6415fa'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:44 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:44 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:45 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "cinder-f75f4f26-9d46-40ad-950a-a1144b0090a0-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:45 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9d4a4245-2ec9-401f-a997-c0404a37be49 1073741824" returned: 0 in 1.641s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:45 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-f75f4f26-9d46-40ad-950a-a1144b0090a0-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:45 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:31:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Flow 'volume_create_manager' (81e81338-280d-48b1-aebd-866a791ec41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bf5c0a-5195-492f-8de3-ed952e644f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9d4a4245-2ec9-401f-a997-c0404a37be49 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bf5c0a-5195-492f-8de3-ed952e644f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-765151353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37d1b71-2f39-49f0-8d48-bafb2d301e05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d48bbb2568d9401882d7e3cfe7c0771e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:46Z,use_quota=True,user_id='7fbdcb7cb0a54c05ba8e0ca9f4c5e7a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412767f3-b6e5-4ceb-b320-74199d0c5e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412767f3-b6e5-4ceb-b320-74199d0c5e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e8272a-137e-4677-95bf-b447c7a29e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e8272a-137e-4677-95bf-b447c7a29e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e37d1b71-2f39-49f0-8d48-bafb2d301e05', 'volume_name': 'volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db44117c-2f3a-45b7-8eec-6bc17e83119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db44117c-2f3a-45b7-8eec-6bc17e83119d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:46 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9d4a4245-2ec9-401f-a997-c0404a37be49 Jun 28 14:31:46 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1188a20b-015f-4189-8d81-24c1623e4b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:46 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Volume e37d1b71-2f39-49f0-8d48-bafb2d301e05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05', 'volume_size': 1} Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "cinder-quobyte-f75f4f26-9d46-40ad-950a-a1144b0090a0" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-quobyte-f75f4f26-9d46-40ad-950a-a1144b0090a0" acquired by "delete_volume" :: waited 0.069s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc9a113-84f2-4769-9f2c-cc4da214f2a1]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f75f4f26-9d46-40ad-950a-a1144b0090a0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:46 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.827s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:46 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Deleted volume successfully. Jun 28 14:31:46 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f75f4f26-9d46-40ad-950a-a1144b0090a0 Jun 28 14:31:46 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d4a1b663-7c0f-43d9-b861-bf1fe052c953 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-f72d516b-6ca2-47ca-9ee1-c7fb451596da-delete_volume" released by "delete_volume" :: held 4.612s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:47 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f75f4f26-9d46-40ad-950a-a1144b0090a0" returned: 0 in 1.516s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f75f4f26-9d46-40ad-950a-a1144b0090a0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:47 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f75f4f26-9d46-40ad-950a-a1144b0090a0 Jun 28 14:31:47 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:47 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9d4a4245-2ec9-401f-a997-c0404a37be49" returned: 0 in 1.902s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] <== create_volume: return (3783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.787s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.776s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-765151353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37d1b71-2f39-49f0-8d48-bafb2d301e05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d48bbb2568d9401882d7e3cfe7c0771e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:31:46Z,use_quota=True,user_id='7fbdcb7cb0a54c05ba8e0ca9f4c5e7a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Creating volume e37d1b71-2f39-49f0-8d48-bafb2d301e05 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:31:47 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0acdf72-25bf-4783-8ed7-7d2360371de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d4a4245-2ec9-401f-a997-c0404a37be49', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:47 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05 1073741824 Jun 28 14:31:47 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e192896f-5d0c-4366-873c-c72d4c0ff573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:47 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Volume volume-9d4a4245-2ec9-401f-a997-c0404a37be49 (9d4a4245-2ec9-401f-a997-c0404a37be49): created successfully Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e192896f-5d0c-4366-873c-c72d4c0ff573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Flow 'volume_create_manager' (01303517-1fb4-4d7d-b42b-b12236c3107f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:47 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-1380ff10-f989-4f53-bf91-5027bb1d7524 tempest-TestMinimumBasicScenario-88048080 None] Created volume successfully. Jun 28 14:31:49 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f75f4f26-9d46-40ad-950a-a1144b0090a0" returned: 0 in 1.278s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-quobyte-f75f4f26-9d46-40ad-950a-a1144b0090a0" released by "delete_volume" :: held 2.899s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:49 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Created reservations ['ac37d846-5316-421c-a5e8-20507eca28d3', '4ff4e695-c9ed-49be-b251-274aa66317b3', '16d49602-51a2-4a4c-8e55-0a2f5f2a1e19', 'ea329208-180f-482c-a689-39f79374eac6'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:49 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:49 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "cinder-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "cinder-quobyte-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-quobyte-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:49 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd0ae3c-1714-440b-beb8-a83477ef7c23]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:49 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3 Jun 28 14:31:49 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:49 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05 1073741824" returned: 0 in 2.119s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:50 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05 Jun 28 14:31:50 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:50 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.255s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:50 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:50 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Deleted volume successfully. Jun 28 14:31:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e4249dcd-7cdf-457e-a3d2-c2a3419d7108 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-f75f4f26-9d46-40ad-950a-a1144b0090a0-delete_volume" released by "delete_volume" :: held 4.938s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:51 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05" returned: 0 in 1.123s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] <== create_volume: return (3370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:31:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.373s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1188a20b-015f-4189-8d81-24c1623e4b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45891e0-c5a8-416f-b572-87e21cb38538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:31:51 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Volume volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05 (e37d1b71-2f39-49f0-8d48-bafb2d301e05): created successfully Jun 28 14:31:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45891e0-c5a8-416f-b572-87e21cb38538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:31:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Flow 'volume_create_manager' (81e81338-280d-48b1-aebd-866a791ec41c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:31:51 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-6f008126-99f4-46e3-93e8-e03a038c4e30 tempest-VolumesTestJSON-1513759991 None] Created volume successfully. Jun 28 14:31:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-75d90385-e529-4877-95e0-62ccc8a4048f tempest-VolumesActionsTest-1814209699 None] Acquiring lock "cinder-8ad2dc66-748f-4b8b-9876-e58e40f86de2" by "attach_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:51 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3" returned: 0 in 1.600s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-75d90385-e529-4877-95e0-62ccc8a4048f tempest-VolumesActionsTest-1814209699 None] Lock "cinder-8ad2dc66-748f-4b8b-9876-e58e40f86de2" acquired by "attach_volume" :: waited 0.029s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:51 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3 Jun 28 14:31:51 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:51 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-75d90385-e529-4877-95e0-62ccc8a4048f tempest-VolumesActionsTest-1814209699 None] Attaching volume 8ad2dc66-748f-4b8b-9876-e58e40f86de2 to instance e0a20492-f404-4226-ac58-4a54c836ea83 at mountpoint /dev/vdb on host None. Jun 28 14:31:51 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-75d90385-e529-4877-95e0-62ccc8a4048f tempest-VolumesActionsTest-1814209699 None] Attach volume completed successfully. Jun 28 14:31:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-75d90385-e529-4877-95e0-62ccc8a4048f tempest-VolumesActionsTest-1814209699 None] Lock "cinder-8ad2dc66-748f-4b8b-9876-e58e40f86de2" released by "attach_volume" :: held 0.114s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cd16199a-a787-4aa5-b7ef-da0113d6cb23 tempest-VolumesActionsTest-1814209699 None] Acquiring lock "cinder-8ad2dc66-748f-4b8b-9876-e58e40f86de2-detach_volume" by "detach_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cd16199a-a787-4aa5-b7ef-da0113d6cb23 tempest-VolumesActionsTest-1814209699 None] Lock "cinder-8ad2dc66-748f-4b8b-9876-e58e40f86de2-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:52 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-cd16199a-a787-4aa5-b7ef-da0113d6cb23 tempest-VolumesActionsTest-1814209699 None] Detaching volume 8ad2dc66-748f-4b8b-9876-e58e40f86de2 from instance e0a20492-f404-4226-ac58-4a54c836ea83. Jun 28 14:31:52 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-cd16199a-a787-4aa5-b7ef-da0113d6cb23 tempest-VolumesActionsTest-1814209699 None] Detach volume completed successfully. Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cd16199a-a787-4aa5-b7ef-da0113d6cb23 tempest-VolumesActionsTest-1814209699 None] Lock "cinder-8ad2dc66-748f-4b8b-9876-e58e40f86de2-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:52 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3" returned: 0 in 0.882s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-quobyte-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3" released by "delete_volume" :: held 2.579s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Created reservations ['381fc1c1-a4fb-463a-a81c-db994b798d54', '1ddd8bac-99e3-4aa6-b9db-e01022cd2cdf', '99eda9f6-aea1-4ffa-aa0b-b14aa61d2cff', '4d6b7db7-55f6-4c19-9dd8-d9f8212de67b'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:52 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:52 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-d0bb7e33-9c85-450a-93c3-ae1d6bf92361 req-6c9c4a14-dfa5-4b63-8acb-83b9cb49a65d tempest-TestMinimumBasicScenario-88048080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-d0bb7e33-9c85-450a-93c3-ae1d6bf92361 req-6c9c4a14-dfa5-4b63-8acb-83b9cb49a65d tempest-TestMinimumBasicScenario-88048080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed88b2ec-4885-4b72-b819-66d845a26daf]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-d0bb7e33-9c85-450a-93c3-ae1d6bf92361 req-6c9c4a14-dfa5-4b63-8acb-83b9cb49a65d tempest-TestMinimumBasicScenario-88048080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9d4a4245-2ec9-401f-a997-c0404a37be49 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:53 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9d4a4245-2ec9-401f-a997-c0404a37be49 Jun 28 14:31:53 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:53 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "cinder-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:53 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:53 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "cinder-quobyte-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:53 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-quobyte-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c" acquired by "delete_volume" :: waited 0.048s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:53 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.059s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:53 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:53 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Deleted volume successfully. Jun 28 14:31:53 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5217a292-393a-4e6d-8b33-8580edece49c]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:53 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-090b2381-f538-4e55-8d33-55085f7161d1 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-0295e5c9-c8b4-46ef-b232-2a330a9ae6a3-delete_volume" released by "delete_volume" :: held 4.074s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:53 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c Jun 28 14:31:53 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Acquiring lock "cinder-e37d1b71-2f39-49f0-8d48-bafb2d301e05-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Lock "cinder-e37d1b71-2f39-49f0-8d48-bafb2d301e05-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Acquiring lock "cinder-quobyte-e37d1b71-2f39-49f0-8d48-bafb2d301e05" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Lock "cinder-quobyte-e37d1b71-2f39-49f0-8d48-bafb2d301e05" acquired by "delete_volume" :: waited 0.039s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:54 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:54 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a288ba7-c20c-432b-b81f-2855d4306cc3]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-d0bb7e33-9c85-450a-93c3-ae1d6bf92361 req-6c9c4a14-dfa5-4b63-8acb-83b9cb49a65d tempest-TestMinimumBasicScenario-88048080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9d4a4245-2ec9-401f-a997-c0404a37be49" returned: 0 in 2.111s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-d0bb7e33-9c85-450a-93c3-ae1d6bf92361 req-6c9c4a14-dfa5-4b63-8acb-83b9cb49a65d tempest-TestMinimumBasicScenario-88048080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.194s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-d0bb7e33-9c85-450a-93c3-ae1d6bf92361 req-6c9c4a14-dfa5-4b63-8acb-83b9cb49a65d tempest-TestMinimumBasicScenario-88048080 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-9d4a4245-2ec9-401f-a997-c0404a37be49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1c493f8-b4dd-40b7-94f9-926b77753e52', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:31:55 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-d0bb7e33-9c85-450a-93c3-ae1d6bf92361 req-6c9c4a14-dfa5-4b63-8acb-83b9cb49a65d tempest-TestMinimumBasicScenario-88048080 None] attachment_update completed successfully. Jun 28 14:31:55 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05 Jun 28 14:31:55 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:55 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c" returned: 0 in 1.614s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:55 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c Jun 28 14:31:55 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:55 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05" returned: 0 in 1.034s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:55 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05 Jun 28 14:31:55 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:56 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c" returned: 0 in 0.781s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-quobyte-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c" released by "delete_volume" :: held 2.579s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:56 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Created reservations ['4406e1bd-ddef-4de3-bb30-6627b6b09b02', '6ee52b08-1b07-475f-8f3b-0a637f89ebe0', '893f4e21-fab6-4a12-b3cc-59e2e5b31f02', 'cf0662c4-8acd-48f9-a9ec-5ec8588a35fc'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:56 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:56 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:56 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e37d1b71-2f39-49f0-8d48-bafb2d301e05" returned: 0 in 0.916s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Lock "cinder-quobyte-e37d1b71-2f39-49f0-8d48-bafb2d301e05" released by "delete_volume" :: held 2.042s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:56 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Created reservations ['1b94c601-5225-4310-b144-46cebf0ced9e', '7b1ae4c8-b8ef-4a3d-ab85-5e62e318e52d', '830774d3-4ef9-4659-bcec-5c182a2a5028', '40c188d9-1e43-4bb1-90b7-1e9340529bed'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:57 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.818s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:57 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Deleted volume successfully. Jun 28 14:31:57 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:57 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a6eeae9d-a2ed-46c8-a4fe-d76a48355700 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-df6fd4bf-32d0-4775-8676-e6ab9f7cf89c-delete_volume" released by "delete_volume" :: held 3.762s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "cinder-ae747cab-4427-4835-b73e-f0d0b9abcd17-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-ae747cab-4427-4835-b73e-f0d0b9abcd17-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "cinder-quobyte-ae747cab-4427-4835-b73e-f0d0b9abcd17" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-quobyte-ae747cab-4427-4835-b73e-f0d0b9abcd17" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[af26a1d0-0007-48ad-89c9-a7b2fe5fe32a]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ae747cab-4427-4835-b73e-f0d0b9abcd17 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:57 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ae747cab-4427-4835-b73e-f0d0b9abcd17 Jun 28 14:31:57 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:57 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.694s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:57 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Deleted volume successfully. Jun 28 14:31:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f49879e0-5864-4c6a-bf0e-294aa23278f6 tempest-VolumesTestJSON-1513759991 None] Lock "cinder-e37d1b71-2f39-49f0-8d48-bafb2d301e05-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:58 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Acquiring lock "cinder-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:58 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Lock "cinder-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:58 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Acquiring lock "cinder-quobyte-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:58 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Lock "cinder-quobyte-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:58 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefa70ea-8333-470b-b1a8-206753c462d0]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:58 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ae747cab-4427-4835-b73e-f0d0b9abcd17" returned: 0 in 0.866s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ae747cab-4427-4835-b73e-f0d0b9abcd17 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:58 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ae747cab-4427-4835-b73e-f0d0b9abcd17 Jun 28 14:31:58 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:58 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9 Jun 28 14:31:58 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:58 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ae747cab-4427-4835-b73e-f0d0b9abcd17" returned: 0 in 0.647s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:58 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-quobyte-ae747cab-4427-4835-b73e-f0d0b9abcd17" released by "delete_volume" :: held 1.552s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:58 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:58 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Created reservations ['1279e88e-ec2b-4005-ac35-f3820cb06634', '1bfe3301-1bfd-4846-a42b-c2f9603fb832', '79489000-ab1b-4a00-8a93-0fcb5627fede', 'ec2a6235-23de-4563-b497-6686df4ff1d9'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9" returned: 0 in 0.798s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:58 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9 Jun 28 14:31:58 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:59 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:31:59 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "cinder-93cf8e25-b72e-41f7-9de4-3668d825fa63-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-93cf8e25-b72e-41f7-9de4-3668d825fa63-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "cinder-quobyte-93cf8e25-b72e-41f7-9de4-3668d825fa63" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-quobyte-93cf8e25-b72e-41f7-9de4-3668d825fa63" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ece53b3-64bb-4bca-94e4-1f62b3cbcccf]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-93cf8e25-b72e-41f7-9de4-3668d825fa63 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:31:59 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9" returned: 0 in 0.772s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Lock "cinder-quobyte-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9" released by "delete_volume" :: held 1.621s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:59 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.770s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:31:59 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Deleted volume successfully. Jun 28 14:31:59 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-93cf8e25-b72e-41f7-9de4-3668d825fa63 Jun 28 14:31:59 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Created reservations ['d3da522d-5980-4543-8a9e-b3a784f7365e', '945bcd22-d945-4926-8ba8-f33597318a95', '63c78164-5253-4092-95e5-c159123fb4c1', 'd8dbe053-f4e3-42ac-a2f8-460154664607'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:31:59 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e978badc-7a19-4ef5-a8cb-c0981f4f55bd tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-ae747cab-4427-4835-b73e-f0d0b9abcd17-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:31:59 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:32:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:32:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:32:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:31:59 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:00 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Acquiring lock "cinder-1001f3fa-4dba-4ef3-a398-4c6656b64054-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:32:00 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Lock "cinder-1001f3fa-4dba-4ef3-a398-4c6656b64054-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:32:00 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Acquiring lock "cinder-quobyte-1001f3fa-4dba-4ef3-a398-4c6656b64054" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:32:00 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Lock "cinder-quobyte-1001f3fa-4dba-4ef3-a398-4c6656b64054" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:32:00 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b71aef0-0aca-440f-9918-3158af31c116]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1001f3fa-4dba-4ef3-a398-4c6656b64054 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:00 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1001f3fa-4dba-4ef3-a398-4c6656b64054 Jun 28 14:32:00 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:01 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.156s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:01 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:32:01 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Deleted volume successfully. Jun 28 14:32:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4cffe0cf-65be-4e66-9814-f7bfb3077c4d tempest-VolumesTestJSON-1513759991 None] Lock "cinder-ab9aab32-36c8-4c73-ac8f-8ee2cad57bd9-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:32:01 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-93cf8e25-b72e-41f7-9de4-3668d825fa63" returned: 0 in 1.529s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-93cf8e25-b72e-41f7-9de4-3668d825fa63 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:01 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-93cf8e25-b72e-41f7-9de4-3668d825fa63 Jun 28 14:32:01 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:02 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1001f3fa-4dba-4ef3-a398-4c6656b64054" returned: 0 in 1.364s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1001f3fa-4dba-4ef3-a398-4c6656b64054 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:02 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1001f3fa-4dba-4ef3-a398-4c6656b64054 Jun 28 14:32:02 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:02 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-93cf8e25-b72e-41f7-9de4-3668d825fa63" returned: 0 in 1.042s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:02 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-quobyte-93cf8e25-b72e-41f7-9de4-3668d825fa63" released by "delete_volume" :: held 2.663s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:32:02 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Created reservations ['27389d6e-d717-43fe-b7a0-b5a895e15e33', '3f38e2f9-4bd4-48ab-8537-c9ec60098520', '1329e058-8d7c-4a27-a3df-fcbf8cd7d1b8', '47126250-68db-4080-8c3e-3322cee5b77a'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:32:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:32:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:32:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:32:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:02 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:32:02 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:03 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1001f3fa-4dba-4ef3-a398-4c6656b64054" returned: 0 in 1.042s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:03 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Lock "cinder-quobyte-1001f3fa-4dba-4ef3-a398-4c6656b64054" released by "delete_volume" :: held 2.500s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:32:03 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Created reservations ['d72c96b6-8b08-4503-b211-81811114f5d9', '0481f2c6-9207-4953-9bad-e31351b642eb', '64927047-14db-4364-9cd1-329660eda2d8', 'f27a5cf1-2cad-4244-92f4-453f9a88eccc'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:32:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:32:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:32:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:32:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:03 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:32:03 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:03 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.988s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:03 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:32:03 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Deleted volume successfully. Jun 28 14:32:03 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cb212e2c-00bd-437d-b5ef-bd1078c21665 tempest-CreateVolumesFromSourceVolumeTest-867288507 None] Lock "cinder-93cf8e25-b72e-41f7-9de4-3668d825fa63-delete_volume" released by "delete_volume" :: held 3.998s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:32:04 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.047s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:04 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:32:04 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Deleted volume successfully. Jun 28 14:32:04 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2d376168-75bb-4046-9a6b-e12dbfbe7e97 tempest-VolumesTestJSON-1513759991 None] Lock "cinder-1001f3fa-4dba-4ef3-a398-4c6656b64054-delete_volume" released by "delete_volume" :: held 3.920s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:32:09 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-3b39edee-08cf-4c5a-a0cf-5b55324c674b tempest-GroupSnapshotsTest-2037888235 None] Group tempest-GroupSnapshotsTest-Group-164114592: creating Jun 28 14:32:09 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-3b39edee-08cf-4c5a-a0cf-5b55324c674b tempest-GroupSnapshotsTest-2037888235 None] Group tempest-GroupSnapshotsTest-Group-164114592: created successfully Jun 28 14:32:09 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-3b39edee-08cf-4c5a-a0cf-5b55324c674b tempest-GroupSnapshotsTest-2037888235 None] Create group completed successfully. Jun 28 14:32:10 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:32:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Flow 'volume_create_manager' (355936f3-25b8-41d1-9491-e5a16494e17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:32:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9237ae3-9c25-46f1-832b-60db5c72622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9237ae3-9c25-46f1-832b-60db5c72622a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb041c6b-d2da-44bc-9d50-97186f95f1d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9228781f52224b9ab86c0475f33150fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:32:10Z,use_quota=True,user_id='11c18d44c8ed4c2b9e561fb3d5dd9044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (768ae1b5-f224-4f7c-82ae-78b418d9d533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (768ae1b5-f224-4f7c-82ae-78b418d9d533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed6d1af-a789-4710-ae4c-34a68dd1d55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:10 devstack cinder-volume[93561]: DEBUG cinder.image.glance [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Creating Keystone auth plugin from conf {{(pid=93561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 28 14:32:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed6d1af-a789-4710-ae4c-34a68dd1d55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb041c6b-d2da-44bc-9d50-97186f95f1d0', 'volume_name': 'volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0', 'volume_size': 1, 'image_id': 'ac5c5ee6-40c4-465a-a051-aecdbfbf3253', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ac5c5ee6-40c4-465a-a051-aecdbfbf3253', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ec813cb8b79a03188f66c89b5a0ac9ef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9228781f52224b9ab86c0475f33150fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '26cfa4a1e15edf25ca3a0c78991523abe5d42ab5bc3326cbde910c93efd9cac59b7aff8159515cfb2aeb36dc88333e6c0e4f1741a4c59147ca6d061842d47b61', 'id': 'ac5c5ee6-40c4-465a-a051-aecdbfbf3253', 'created_at': datetime.datetime(2026, 6, 28, 12, 32, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 32, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ac5c5ee6-40c4-465a-a051-aecdbfbf3253/file', 'properties': {}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a8ba55-04b4-45e7-bc23-66a4b2a4ef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a8ba55-04b4-45e7-bc23-66a4b2a4ef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e9be5c-a2cf-4ca2-adcc-9b945402abf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:11 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Volume cb041c6b-d2da-44bc-9d50-97186f95f1d0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0', 'volume_size': 1, 'image_id': 'ac5c5ee6-40c4-465a-a051-aecdbfbf3253', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ac5c5ee6-40c4-465a-a051-aecdbfbf3253', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ec813cb8b79a03188f66c89b5a0ac9ef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9228781f52224b9ab86c0475f33150fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '26cfa4a1e15edf25ca3a0c78991523abe5d42ab5bc3326cbde910c93efd9cac59b7aff8159515cfb2aeb36dc88333e6c0e4f1741a4c59147ca6d061842d47b61', 'id': 'ac5c5ee6-40c4-465a-a051-aecdbfbf3253', 'created_at': datetime.datetime(2026, 6, 28, 12, 32, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 32, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ac5c5ee6-40c4-465a-a051-aecdbfbf3253/file', 'properties': {}}, 'image_service': } Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Trying to clone cb041c6b-d2da-44bc-9d50-97186f95f1d0 from image ac5c5ee6-40c4-465a-a051-aecdbfbf3253 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ac5c5ee6-40c4-465a-a051-aecdbfbf3253', 'metadata': {}}]). {{(pid=93561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Flow 'volume_create_manager' (712b9d8b-338e-4add-9f4d-4d5a72125111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2e7c51-6bdf-4593-9544-3603d94dfca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2e7c51-6bdf-4593-9544-3603d94dfca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-912273494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=96636bf5-b289-473e-aa4f-f4e3494ac1a5,host='devstack@QuobyteHD#QuobyteHD',id=bd687824-b3d9-41da-b1a4-a2afe0e0db7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb80402f803403db228259188db089e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:32:11Z,use_quota=True,user_id='584fdf37202a4aa8b9cee1f2737e7e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90dd41a9-bfb1-451d-8d75-e11ec0de6fc8),volume_type_id=90dd41a9-bfb1-451d-8d75-e11ec0de6fc8)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc9260c-5442-4f76-958d-dc35ad826a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc9260c-5442-4f76-958d-dc35ad826a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e197f21d-d60e-4ede-bfe2-ce191ac04881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e197f21d-d60e-4ede-bfe2-ce191ac04881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd687824-b3d9-41da-b1a4-a2afe0e0db7e', 'volume_name': 'volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e41f839-4b4a-448f-a514-b68e222fd1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e41f839-4b4a-448f-a514-b68e222fd1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227f50a2-51d6-4569-9a5b-1a367f01bfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:11 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Volume bd687824-b3d9-41da-b1a4-a2afe0e0db7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e', 'volume_size': 1} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=96636bf5-b289-473e-aa4f-f4e3494ac1a5,created_at=2026-06-28T12:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-912273494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=96636bf5-b289-473e-aa4f-f4e3494ac1a5,host='devstack@QuobyteHD#QuobyteHD',id=bd687824-b3d9-41da-b1a4-a2afe0e0db7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb80402f803403db228259188db089e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:32:11Z,use_quota=True,user_id='584fdf37202a4aa8b9cee1f2737e7e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90dd41a9-bfb1-451d-8d75-e11ec0de6fc8),volume_type_id=90dd41a9-bfb1-451d-8d75-e11ec0de6fc8)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Creating volume bd687824-b3d9-41da-b1a4-a2afe0e0db7e {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:32:11 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:11 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e 1073741824 Jun 28 14:32:11 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 28 14:32:11 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Image download 0.00 MB at 0.00 MB/s Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdf7c4c-f69f-4bf5-87cc-ac55906d90bd]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:11 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD Jun 28 14:32:11 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:12 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD" returned: 0 in 0.889s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:12 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e 1073741824" returned: 0 in 1.051s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:12 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD Jun 28 14:32:12 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:12 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e Jun 28 14:32:12 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:13 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD" returned: 1 in 0.970s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Temporary image ac5c5ee6-40c4-465a-a051-aecdbfbf3253 is fetched for user 11c18d44c8ed4c2b9e561fb3d5dd9044. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 28 14:32:13 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e" returned: 0 in 0.888s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227f50a2-51d6-4569-9a5b-1a367f01bfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2c75e9-0394-4610-8252-592b4653eba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:13 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Volume volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e (bd687824-b3d9-41da-b1a4-a2afe0e0db7e): created successfully Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2c75e9-0394-4610-8252-592b4653eba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Flow 'volume_create_manager' (712b9d8b-338e-4add-9f4d-4d5a72125111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:32:13 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-45b7133f-b393-470b-914d-b8cdf7379b1c tempest-GroupSnapshotsTest-2037888235 None] Created volume successfully. Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05bf839-f431-4ae5-accd-4f228dce6038]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:13 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD Jun 28 14:32:13 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:13 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] GroupSnapshot 5a174024-808b-4c31-b114-cbc75853b403: creating. Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] Group snapshot 5a174024-808b-4c31-b114-cbc75853b403: creating. {{(pid=93561) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] Creating offline snapshot 43c259b3-c27c-4336-b8e2-24fb6d594f50 of volume bd687824-b3d9-41da-b1a4-a2afe0e0db7e {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98d5b50-dba6-4c42-830a-8108f2cdf685]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:14 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e Jun 28 14:32:14 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:14 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD" returned: 0 in 0.807s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:14 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD Jun 28 14:32:14 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:14 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e" returned: 0 in 0.839s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:14 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 1G Jun 28 14:32:14 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:15 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD" returned: 1 in 0.809s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:32:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:15 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 1G" returned: 0 in 0.876s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:15 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 Jun 28 14:32:15 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:16 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50" returned: 0 in 0.782s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:16 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 is being set with open permissions: ugo+rw: NotImplementedError Jun 28 14:32:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:16 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 Jun 28 14:32:16 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:17 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50" returned: 0 in 0.687s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:17 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.info Jun 28 14:32:17 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:17 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.info" returned: 0 in 0.641s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:17 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.info is being set with open permissions: ugo+rw: NotImplementedError Jun 28 14:32:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:17 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.info Jun 28 14:32:17 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:18 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.info" returned: 0 in 1.082s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.022s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:32:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.961s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb041c6b-d2da-44bc-9d50-97186f95f1d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9228781f52224b9ab86c0475f33150fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:32:10Z,use_quota=True,user_id='11c18d44c8ed4c2b9e561fb3d5dd9044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:32:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Creating volume cb041c6b-d2da-44bc-9d50-97186f95f1d0 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:32:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:32:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:32:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:32:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:32:18 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:32:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:19 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 1073741824 Jun 28 14:32:19 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:19 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-733c2350-b438-4aa0-b64e-503bb6112f80 tempest-GroupSnapshotsTest-2037888235 None] group_snapshot 5a174024-808b-4c31-b114-cbc75853b403: created successfully Jun 28 14:32:20 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 1073741824" returned: 0 in 1.215s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:20 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 Jun 28 14:32:20 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:21 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0" returned: 0 in 1.324s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] <== create_volume: return (2600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.604s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.596s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "cinder-quobyte-43c259b3-c27c-4336-b8e2-24fb6d594f50-20e5c70e-110f-4f24-bbf4-c1c28be55fdd" by "_create_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-43c259b3-c27c-4336-b8e2-24fb6d594f50-20e5c70e-110f-4f24-bbf4-c1c28be55fdd" acquired by "_create_volume_from_snapshot" :: waited 0.056s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Creating volume 20e5c70e-110f-4f24-bbf4-c1c28be55fdd from snapshot 43c259b3-c27c-4336-b8e2-24fb6d594f50 {{(pid=93561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "cinder-quobyte-20e5c70e-110f-4f24-bbf4-c1c28be55fdd" by "_copy_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Attempting download of ac5c5ee6-40c4-465a-a051-aecdbfbf3253 ((None, [{'url': 'file:///opt/stack/data/glance/images/ac5c5ee6-40c4-465a-a051-aecdbfbf3253', 'metadata': {}}])) to volume cb041c6b-d2da-44bc-9d50-97186f95f1d0. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-20e5c70e-110f-4f24-bbf4-c1c28be55fdd" acquired by "_copy_volume_from_snapshot" :: waited 0.059s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] snapshot: 43c259b3-c27c-4336-b8e2-24fb6d594f50, volume: 20e5c70e-110f-4f24-bbf4-c1c28be55fdd, {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b837b743-4f81-4a60-972d-3eeb283fb34a]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:22 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61265cc-981d-4222-b956-51a4fe30937f]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_vdrtxvy8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:22 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 Jun 28 14:32:22 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:22 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_vdrtxvy8 Jun 28 14:32:22 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:23 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50" returned: 0 in 1.479s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:32:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 28 14:32:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Creating direct copy from snapshot {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 28 14:32:23 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df7b122-e495-45b7-85ad-a4630df16670]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:23 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e Jun 28 14:32:23 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:23 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_vdrtxvy8" returned: 0 in 1.735s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_vdrtxvy8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:23 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_vdrtxvy8 Jun 28 14:32:23 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:24 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e" returned: 0 in 1.101s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:24 devstack cinder-volume[93561]: DEBUG cinder.utils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Path /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20e5c70e-110f-4f24-bbf4-c1c28be55fdd not found in is_blk_device check {{(pid=93561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 28 14:32:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20e5c70e-110f-4f24-bbf4-c1c28be55fdd {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:24 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20e5c70e-110f-4f24-bbf4-c1c28be55fdd Jun 28 14:32:24 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:24 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_vdrtxvy8" returned: 1 in 0.968s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_vdrtxvy8' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:32:24 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c45eca-dc44-4460-bc90-c33b96731a28]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:25 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD Jun 28 14:32:25 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7fc8c72c-c890-439e-b6e2-32e53b3097fc tempest-VolumesActionsTest-1814209699 None] Acquiring lock "cinder-8ad2dc66-748f-4b8b-9876-e58e40f86de2" by "attach_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:32:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7fc8c72c-c890-439e-b6e2-32e53b3097fc tempest-VolumesActionsTest-1814209699 None] Lock "cinder-8ad2dc66-748f-4b8b-9876-e58e40f86de2" acquired by "attach_volume" :: waited 0.034s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:32:25 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7fc8c72c-c890-439e-b6e2-32e53b3097fc tempest-VolumesActionsTest-1814209699 None] Attaching volume 8ad2dc66-748f-4b8b-9876-e58e40f86de2 to instance c139a403-d6a8-4ceb-8ff0-872fbeb14a65 at mountpoint /dev/vdb on host None. Jun 28 14:32:25 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7fc8c72c-c890-439e-b6e2-32e53b3097fc tempest-VolumesActionsTest-1814209699 None] Attach volume completed successfully. Jun 28 14:32:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7fc8c72c-c890-439e-b6e2-32e53b3097fc tempest-VolumesActionsTest-1814209699 None] Lock "cinder-8ad2dc66-748f-4b8b-9876-e58e40f86de2" released by "attach_volume" :: held 0.131s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:32:26 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD" returned: 0 in 1.432s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ccd3c54d-60ce-4175-aca6-821b4a8912b5 tempest-VolumesActionsTest-1814209699 None] Acquiring lock "cinder-8ad2dc66-748f-4b8b-9876-e58e40f86de2-detach_volume" by "detach_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:32:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ccd3c54d-60ce-4175-aca6-821b4a8912b5 tempest-VolumesActionsTest-1814209699 None] Lock "cinder-8ad2dc66-748f-4b8b-9876-e58e40f86de2-detach_volume" acquired by "detach_volume" :: waited 0.073s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:32:26 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ccd3c54d-60ce-4175-aca6-821b4a8912b5 tempest-VolumesActionsTest-1814209699 None] Detaching volume 8ad2dc66-748f-4b8b-9876-e58e40f86de2 from instance c139a403-d6a8-4ceb-8ff0-872fbeb14a65. Jun 28 14:32:26 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ccd3c54d-60ce-4175-aca6-821b4a8912b5 tempest-VolumesActionsTest-1814209699 None] Detach volume completed successfully. Jun 28 14:32:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ccd3c54d-60ce-4175-aca6-821b4a8912b5 tempest-VolumesActionsTest-1814209699 None] Lock "cinder-8ad2dc66-748f-4b8b-9876-e58e40f86de2-detach_volume" released by "detach_volume" :: held 0.227s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:32:26 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD Jun 28 14:32:26 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:29 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD" returned: 1 in 3.573s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:32:29 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] ac5c5ee6-40c4-465a-a051-aecdbfbf3253 was raw, converting to raw {{(pid=93561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 28 14:32:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:29 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 Jun 28 14:32:29 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:32 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0" returned: 0 in 3.016s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:32 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ac5c5ee6-40c4-465a-a051-aecdbfbf3253_quq0wbtidevstack@QuobyteHD, size 0.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:32:32 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Converted 0.00 MB image at 0.00 MB/s Jun 28 14:32:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:32 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 1G Jun 28 14:32:32 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:34 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20e5c70e-110f-4f24-bbf4-c1c28be55fdd" returned: 0 in 9.648s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:34 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b56580e-2666-4249-8f82-4fd212696bc8]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:34 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e Jun 28 14:32:34 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:34 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 1G" returned: 0 in 1.589s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:34 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[52347719-b4f7-44a7-ae33-b0e7d26b1174]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:34 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 Jun 28 14:32:34 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:35 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0" returned: 0 in 0.889s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:35 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 Jun 28 14:32:35 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:35 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e" returned: 0 in 1.205s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:35 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Image conversion details: src /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e, size 1024.00 MB, duration 9.65 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20e5c70e-110f-4f24-bbf4-c1c28be55fdd {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:32:35 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Converted 1024.00 MB image at 106.11 MB/s Jun 28 14:32:35 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20e5c70e-110f-4f24-bbf4-c1c28be55fdd is being set with open permissions: ugo+rw: NotImplementedError Jun 28 14:32:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20e5c70e-110f-4f24-bbf4-c1c28be55fdd {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:35 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20e5c70e-110f-4f24-bbf4-c1c28be55fdd Jun 28 14:32:35 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:36 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20e5c70e-110f-4f24-bbf4-c1c28be55fdd" returned: 0 in 0.781s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:36 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0" returned: 1 in 0.919s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Downloaded image ac5c5ee6-40c4-465a-a051-aecdbfbf3253 ((None, [{'url': 'file:///opt/stack/data/glance/images/ac5c5ee6-40c4-465a-a051-aecdbfbf3253', 'metadata': {}}])) to volume cb041c6b-d2da-44bc-9d50-97186f95f1d0 successfully. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Temporary image ac5c5ee6-40c4-465a-a051-aecdbfbf3253 for user 11c18d44c8ed4c2b9e561fb3d5dd9044 is deleted. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Marking volume cb041c6b-d2da-44bc-9d50-97186f95f1d0 as bootable. {{(pid=93561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-20e5c70e-110f-4f24-bbf4-c1c28be55fdd" released by "_copy_volume_from_snapshot" :: held 14.508s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:DELETE=11,cinder:SELECT=92,cinder:UPDATE=116,cinder:INSERT=28 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-43c259b3-c27c-4336-b8e2-24fb6d594f50-20e5c70e-110f-4f24-bbf4-c1c28be55fdd" released by "_create_volume_from_snapshot" :: held 14.612s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.671s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=99,cinder:UPDATE=118,cinder:INSERT=25,cinder:DELETE=9 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Copying metadata from image ac5c5ee6-40c4-465a-a051-aecdbfbf3253 to cb041c6b-d2da-44bc-9d50-97186f95f1d0. {{(pid=93561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Creating volume glance metadata for volume cb041c6b-d2da-44bc-9d50-97186f95f1d0 backed by image ac5c5ee6-40c4-465a-a051-aecdbfbf3253 with: {'image_id': 'ac5c5ee6-40c4-465a-a051-aecdbfbf3253', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ec813cb8b79a03188f66c89b5a0ac9ef', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e9be5c-a2cf-4ca2-adcc-9b945402abf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0', 'volume_size': 1, 'image_id': 'ac5c5ee6-40c4-465a-a051-aecdbfbf3253', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ac5c5ee6-40c4-465a-a051-aecdbfbf3253', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ec813cb8b79a03188f66c89b5a0ac9ef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9228781f52224b9ab86c0475f33150fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '26cfa4a1e15edf25ca3a0c78991523abe5d42ab5bc3326cbde910c93efd9cac59b7aff8159515cfb2aeb36dc88333e6c0e4f1741a4c59147ca6d061842d47b61', 'id': 'ac5c5ee6-40c4-465a-a051-aecdbfbf3253', 'created_at': datetime.datetime(2026, 6, 28, 12, 32, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 32, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ac5c5ee6-40c4-465a-a051-aecdbfbf3253/file', 'properties': {}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26afd3ae-9e8c-4f59-8f0c-98cca1ca33e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:36 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Volume volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 (cb041c6b-d2da-44bc-9d50-97186f95f1d0): created successfully Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26afd3ae-9e8c-4f59-8f0c-98cca1ca33e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Flow 'volume_create_manager' (355936f3-25b8-41d1-9491-e5a16494e17f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:32:36 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-b270f46e-84cd-4366-b8e6-5ad03605f5ed tempest-GroupSnapshotsTest-2037888235 None] Create group from source-snapshot-5a174024-808b-4c31-b114-cbc75853b403 completed successfully. Jun 28 14:32:36 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-45823a4b-3b1b-414d-8e72-ed9b57845b07 tempest-VolumeImageDependencyTests-812497027 None] Created volume successfully. Jun 28 14:32:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Acquiring lock "cinder-cb041c6b-d2da-44bc-9d50-97186f95f1d0-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Lock "cinder-cb041c6b-d2da-44bc-9d50-97186f95f1d0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Acquiring lock "cinder-quobyte-cb041c6b-d2da-44bc-9d50-97186f95f1d0" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Lock "cinder-quobyte-cb041c6b-d2da-44bc-9d50-97186f95f1d0" acquired by "delete_volume" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[842d6202-d53b-4161-80ed-3e310f53cf1e]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:37 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 Jun 28 14:32:37 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "cinder-quobyte-20e5c70e-110f-4f24-bbf4-c1c28be55fdd" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-20e5c70e-110f-4f24-bbf4-c1c28be55fdd" acquired by "delete_volume" :: waited 0.024s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e48ff61-8b2d-4ccc-8370-0aca4c40acaf]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20e5c70e-110f-4f24-bbf4-c1c28be55fdd {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:37 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:32:37 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:38 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20e5c70e-110f-4f24-bbf4-c1c28be55fdd Jun 28 14:32:38 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:38 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0" returned: 0 in 0.986s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:38 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 Jun 28 14:32:38 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:38 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.770s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 28 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:32:38 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20e5c70e-110f-4f24-bbf4-c1c28be55fdd" returned: 0 in 0.884s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20e5c70e-110f-4f24-bbf4-c1c28be55fdd {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:38 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20e5c70e-110f-4f24-bbf4-c1c28be55fdd Jun 28 14:32:38 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc171d2-c24c-40b2-bccd-38d88dc88ffa]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:38 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0" returned: 1 in 0.838s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:32:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:38 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 Jun 28 14:32:38 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:38 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0 Jun 28 14:32:38 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:39 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20e5c70e-110f-4f24-bbf4-c1c28be55fdd" returned: 0 in 0.720s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-20e5c70e-110f-4f24-bbf4-c1c28be55fdd" released by "delete_volume" :: held 1.677s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Created reservations ['866c08b0-5d4e-4570-8e38-51986f234694'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:32:39 devstack cinder-volume[93561]: WARNING cinder.quota [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-656021419 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-656021419, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:32:39 devstack cinder-volume[93561]: WARNING cinder.quota [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-656021419 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-656021419, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Created reservations ['81794d9b-8546-4f00-8424-cd79a046105c', 'f3a96e39-6937-49f7-a467-7ecab8e88ada', 'a0a0f28d-ed69-42fc-8bf3-7b150156856c', '7bb9f62e-7937-45ba-88b4-d144844a8a20'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:32:39 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:39 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2" returned: 0 in 0.809s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cb041c6b-d2da-44bc-9d50-97186f95f1d0" returned: 0 in 0.709s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c850912-0958-48ff-88df-a07e0abef76c]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Lock "cinder-quobyte-cb041c6b-d2da-44bc-9d50-97186f95f1d0" released by "delete_volume" :: held 2.614s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Created reservations ['9b3fc8f3-a7b4-40cb-aad5-919bee8f53b3', 'd83c3ae2-b885-487f-a630-7dbb9a7edf67', 'c722fa1c-797a-4c52-b15e-e0491265388c', '60199fcd-cb93-4ac0-818f-c76556cc83c3'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:32:39 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 Jun 28 14:32:39 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:39 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:32:39 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:32:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:39 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:32:39 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:40 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] group_snapshot 5a174024-808b-4c31-b114-cbc75853b403: deleting Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] group_snapshot 5a174024-808b-4c31-b114-cbc75853b403: deleting {{(pid=93561) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "cinder-quobyte-bd687824-b3d9-41da-b1a4-a2afe0e0db7e" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-bd687824-b3d9-41da-b1a4-a2afe0e0db7e" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "cinder-quobyte-43c259b3-c27c-4336-b8e2-24fb6d594f50" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-43c259b3-c27c-4336-b8e2-24fb6d594f50" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] Deleting offline snapshot 43c259b3-c27c-4336-b8e2-24fb6d594f50 of volume bd687824-b3d9-41da-b1a4-a2afe0e0db7e {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] snapshot_file for this snap is: volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a10f4f3-55d4-4c2c-be2d-de81f21e8717]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:40 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.023s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:32:40 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-2451a905-3eca-4361-b7e9-11d22b13ea45 tempest-GroupSnapshotsTest-2037888235 None] Delete group completed successfully. Jun 28 14:32:40 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.958s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:32:40 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 Jun 28 14:32:40 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:40 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Deleted volume successfully. Jun 28 14:32:40 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2" returned: 0 in 1.175s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.93e0f296-7a23-4fe2-b40c-2a7f2930b540r3nfc75f.img {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-49c98502-76a1-4ae5-a17d-4b4254948de8 tempest-VolumeImageDependencyTests-812497027 None] Lock "cinder-cb041c6b-d2da-44bc-9d50-97186f95f1d0-delete_volume" released by "delete_volume" :: held 3.871s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:32:40 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.93e0f296-7a23-4fe2-b40c-2a7f2930b540r3nfc75f.img Jun 28 14:32:40 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:41 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50" returned: 0 in 0.964s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:41 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:32:41 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d86a80e-2860-4f88-8959-6ae351ac069e]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:42 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e Jun 28 14:32:42 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:43 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e" returned: 0 in 1.998s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:43 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 Jun 28 14:32:43 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:44 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50" returned: 0 in 1.238s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:44 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50 Jun 28 14:32:44 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:46 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e.43c259b3-c27c-4336-b8e2-24fb6d594f50" returned: 0 in 1.218s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-43c259b3-c27c-4336-b8e2-24fb6d594f50" released by "_delete_snapshot" :: held 5.609s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:32:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-bd687824-b3d9-41da-b1a4-a2afe0e0db7e" released by "delete_snapshot" :: held 5.658s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:32:46 devstack cinder-volume[93561]: WARNING cinder.quota [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-656021419 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-656021419, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:32:46 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] Created reservations ['91700289-33e8-464a-bae6-82280ac9ddd9', 'e46d0b58-7d88-4dcf-b8d2-fec49efcb92c', '99543985-8eff-46a8-ba44-f637efaef685', 'c40b79eb-690d-45c8-8870-b36c2b35678c'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:32:46 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7b66a07b-e906-4e9c-a4be-fbe2f1391ec9 tempest-GroupSnapshotsTest-2037888235 None] group_snapshot 5a174024-808b-4c31-b114-cbc75853b403: deleted successfully Jun 28 14:32:46 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.93e0f296-7a23-4fe2-b40c-2a7f2930b540r3nfc75f.img" returned: 0 in 5.797s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:46 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[77af6932-e6f4-4a45-ae3c-da9555b101b4]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:46 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 Jun 28 14:32:46 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:47 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2" returned: 0 in 0.909s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:47 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] Image conversion details: src /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.93e0f296-7a23-4fe2-b40c-2a7f2930b540r3nfc75f.img {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:32:47 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] Converted 1024.00 MB image at 176.63 MB/s Jun 28 14:32:47 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] 93e0f296-7a23-4fe2-b40c-2a7f2930b540 was raw, no need to convert to raw {{(pid=93561) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 28 14:32:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "cinder-quobyte-bd687824-b3d9-41da-b1a4-a2afe0e0db7e" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:32:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-bd687824-b3d9-41da-b1a4-a2afe0e0db7e" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:32:47 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3003948-ee9a-4cd8-b7a2-3de84f67ff07]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:32:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:47 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e Jun 28 14:32:47 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:48 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e" returned: 0 in 0.782s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:48 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e Jun 28 14:32:48 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:49 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-bd687824-b3d9-41da-b1a4-a2afe0e0db7e" returned: 0 in 0.687s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-bd687824-b3d9-41da-b1a4-a2afe0e0db7e" released by "delete_volume" :: held 1.542s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:32:49 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Created reservations ['feff4f2c-5d5b-4cea-9bcd-67b652192cec'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:32:49 devstack cinder-volume[93561]: WARNING cinder.db.api [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-656021419'] Jun 28 14:32:49 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Created reservations ['c610da9f-6472-4d63-80a6-b11209bd00b3', '0956582d-2c28-4051-ad65-a241773f56e2', '235e7532-ed4d-47ed-8e50-d1cd40ee95cb', 'e622b3f4-b30e-4966-b4d6-e05f8b1cd3aa'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:32:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:32:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:32:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:32:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:32:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:32:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:32:49 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:32:49 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:32:50 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jun 28 14:32:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.706s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:32:50 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:32:50 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-96fd3f1f-7d5a-4aeb-9138-4f0525077b21 tempest-GroupSnapshotsTest-2037888235 None] Delete group completed successfully. Jun 28 14:32:50 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a4f2bee0-e11f-4e9e-98d3-fc1526836766 tempest-GroupSnapshotsTest-2037888235 None] Group tempest-GroupSnapshotsTest-Group-2066808257: creating Jun 28 14:32:50 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a4f2bee0-e11f-4e9e-98d3-fc1526836766 tempest-GroupSnapshotsTest-2037888235 None] Group tempest-GroupSnapshotsTest-Group-2066808257: created successfully Jun 28 14:32:50 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a4f2bee0-e11f-4e9e-98d3-fc1526836766 tempest-GroupSnapshotsTest-2037888235 None] Create group completed successfully. Jun 28 14:32:52 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:32:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Flow 'volume_create_manager' (bb52e6f9-0e98-4f32-a271-a6bb79f6cc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:32:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f85e14b-ae0f-490c-aac6-4331f7844b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f85e14b-ae0f-490c-aac6-4331f7844b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1686188653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fe0dc55-a15b-48a9-940c-4988035f54a2,host='devstack@QuobyteHD#QuobyteHD',id=829b3975-5ee0-4182-98df-8e9c1e295a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb80402f803403db228259188db089e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:32:52Z,use_quota=True,user_id='584fdf37202a4aa8b9cee1f2737e7e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9eff4626-9dc1-494e-8d67-5fe5fa135a63),volume_type_id=9eff4626-9dc1-494e-8d67-5fe5fa135a63)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c40f10-97f1-40e1-9e12-394b3f9f21de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c40f10-97f1-40e1-9e12-394b3f9f21de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c7df71-e879-4a29-8cfc-e3adb6a5803e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c7df71-e879-4a29-8cfc-e3adb6a5803e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '829b3975-5ee0-4182-98df-8e9c1e295a93', 'volume_name': 'volume-829b3975-5ee0-4182-98df-8e9c1e295a93', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8fdfb1-0770-4ee3-8d73-13f92c5ffb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8fdfb1-0770-4ee3-8d73-13f92c5ffb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:32:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab2f84a-6897-45c5-b5a7-2cd21c85fa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:32:52 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Volume 829b3975-5ee0-4182-98df-8e9c1e295a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-829b3975-5ee0-4182-98df-8e9c1e295a93', 'volume_size': 1} Jun 28 14:32:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:02 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:INSERT=12,cinder:UPDATE=41,cinder:SELECT=28,cinder:DELETE=2 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:33:02 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=50,cinder:UPDATE=37,cinder:INSERT=14 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:33:04 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-f13a2278-035f-441c-8b9e-c87f0bb48496 req-f6a493c5-4612-4cb7-98f0-7cb69a881364 tempest-TestMinimumBasicScenario-88048080 None] Terminate volume connection completed successfully. Jun 28 14:33:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-f13a2278-035f-441c-8b9e-c87f0bb48496 req-f6a493c5-4612-4cb7-98f0-7cb69a881364 tempest-TestMinimumBasicScenario-88048080 None] Deleting attachment c1c493f8-b4dd-40b7-94f9-926b77753e52. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:33:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Acquiring lock "cinder-9d4a4245-2ec9-401f-a997-c0404a37be49-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:33:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Lock "cinder-9d4a4245-2ec9-401f-a997-c0404a37be49-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:33:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Acquiring lock "cinder-quobyte-9d4a4245-2ec9-401f-a997-c0404a37be49" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:33:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Lock "cinder-quobyte-9d4a4245-2ec9-401f-a997-c0404a37be49" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:33:06 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0891994-988e-47f8-b63d-f45ebffadfd8]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9d4a4245-2ec9-401f-a997-c0404a37be49 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:06 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9d4a4245-2ec9-401f-a997-c0404a37be49 Jun 28 14:33:06 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:07 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.928s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] Uploaded volume to glance image-id: 93e0f296-7a23-4fe2-b40c-2a7f2930b540. {{(pid=93561) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 28 14:33:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.481s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4fe0dc55-a15b-48a9-940c-4988035f54a2,created_at=2026-06-28T12:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1686188653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fe0dc55-a15b-48a9-940c-4988035f54a2,host='devstack@QuobyteHD#QuobyteHD',id=829b3975-5ee0-4182-98df-8e9c1e295a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb80402f803403db228259188db089e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:32:52Z,use_quota=True,user_id='584fdf37202a4aa8b9cee1f2737e7e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9eff4626-9dc1-494e-8d67-5fe5fa135a63),volume_type_id=9eff4626-9dc1-494e-8d67-5fe5fa135a63)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:33:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Creating volume 829b3975-5ee0-4182-98df-8e9c1e295a93 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:33:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:33:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:33:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:33:07 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:33:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9d4a4245-2ec9-401f-a997-c0404a37be49" returned: 0 in 0.958s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9d4a4245-2ec9-401f-a997-c0404a37be49 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:07 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93 1073741824 Jun 28 14:33:07 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:07 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ba7066e0-6406-40a5-a6d1-6a67038242bb tempest-VolumesActionsTest-1814209699 None] Copy volume to image completed successfully. Jun 28 14:33:07 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9d4a4245-2ec9-401f-a997-c0404a37be49 Jun 28 14:33:07 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:08 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9d4a4245-2ec9-401f-a997-c0404a37be49" returned: 0 in 0.685s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:08 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Lock "cinder-quobyte-9d4a4245-2ec9-401f-a997-c0404a37be49" released by "delete_volume" :: held 1.701s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:33:08 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Created reservations ['3936b813-34c3-4396-ab1b-34b752915acc', '3b8fd3d4-66d1-41ba-aa22-f075939916c2', '3659614f-063c-4114-84fd-9f4d331a89ab', '0a610f15-29d5-4c53-97f8-8c38c98b036f'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:33:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:33:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:33:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:08 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:33:08 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:08 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93 1073741824" returned: 0 in 0.930s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:08 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93 Jun 28 14:33:08 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:09 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.705s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:09 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:33:09 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Deleted volume successfully. Jun 28 14:33:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-378eb3d5-9431-4e78-a2a7-acf4d6cdcd53 tempest-TestMinimumBasicScenario-88048080 None] Lock "cinder-9d4a4245-2ec9-401f-a997-c0404a37be49-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:33:09 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93" returned: 0 in 0.750s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:33:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab2f84a-6897-45c5-b5a7-2cd21c85fa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-829b3975-5ee0-4182-98df-8e9c1e295a93', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25aba1cb-5873-4623-8ef4-ceed116027da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:09 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Volume volume-829b3975-5ee0-4182-98df-8e9c1e295a93 (829b3975-5ee0-4182-98df-8e9c1e295a93): created successfully Jun 28 14:33:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25aba1cb-5873-4623-8ef4-ceed116027da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Flow 'volume_create_manager' (bb52e6f9-0e98-4f32-a271-a6bb79f6cc0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:33:09 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-2a10fec5-aa0b-42ee-b72c-3db209c7ac20 tempest-GroupSnapshotsTest-2037888235 None] Created volume successfully. Jun 28 14:33:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:09 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1574123c-a71f-4377-9fb6-d0162fff8c30]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:09 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 Jun 28 14:33:09 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:10 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2" returned: 0 in 0.927s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:10 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc65fe39-6166-44d0-9ce2-810933c1082d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:10 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 Jun 28 14:33:10 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:10 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:33:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Flow 'volume_create_manager' (01baeae4-7eba-408f-b215-d3f3204320a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:33:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99011e2b-f256-4043-98ea-49907dd9ba96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99011e2b-f256-4043-98ea-49907dd9ba96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1125184904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fe0dc55-a15b-48a9-940c-4988035f54a2,host='devstack@QuobyteHD#QuobyteHD',id=c6e977f3-07d7-490c-b124-fdc469722378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb80402f803403db228259188db089e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:33:11Z,use_quota=True,user_id='584fdf37202a4aa8b9cee1f2737e7e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9eff4626-9dc1-494e-8d67-5fe5fa135a63),volume_type_id=9eff4626-9dc1-494e-8d67-5fe5fa135a63)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12887bc-b3c6-4fb1-b444-6a512be81d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12887bc-b3c6-4fb1-b444-6a512be81d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fd619f-f4e3-499d-8e37-9ba77cc31060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fd619f-f4e3-499d-8e37-9ba77cc31060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6e977f3-07d7-490c-b124-fdc469722378', 'volume_name': 'volume-c6e977f3-07d7-490c-b124-fdc469722378', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be8db81-b358-4655-99fa-285378e014ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be8db81-b358-4655-99fa-285378e014ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd9e79c-02f0-47e7-9adc-3b146231588e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:11 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Volume c6e977f3-07d7-490c-b124-fdc469722378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6e977f3-07d7-490c-b124-fdc469722378', 'volume_size': 1} Jun 28 14:33:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:11 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2" returned: 0 in 0.894s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.3741ad83-adec-478b-bf3c-bed4ccc0feb7q5gnkfxz.img {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:11 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.3741ad83-adec-478b-bf3c-bed4ccc0feb7q5gnkfxz.img Jun 28 14:33:11 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:16 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.3741ad83-adec-478b-bf3c-bed4ccc0feb7q5gnkfxz.img" returned: 0 in 4.869s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:16 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ca1a6b-9b73-4841-a814-1a69ef3da983]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:16 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 Jun 28 14:33:16 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:17 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2" returned: 0 in 0.981s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:17 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Image conversion details: src /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2, size 1024.00 MB, duration 4.87 sec, destination /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.3741ad83-adec-478b-bf3c-bed4ccc0feb7q5gnkfxz.img {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:33:17 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Converted 1024.00 MB image at 210.24 MB/s Jun 28 14:33:17 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] 3741ad83-adec-478b-bf3c-bed4ccc0feb7 was raw, converting to qcow2 {{(pid=93561) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 28 14:33:17 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[728b068f-098d-49e8-9ce9-668fabead900]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.3741ad83-adec-478b-bf3c-bed4ccc0feb7q5gnkfxz.img {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:17 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.3741ad83-adec-478b-bf3c-bed4ccc0feb7q5gnkfxz.img Jun 28 14:33:17 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:18 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.3741ad83-adec-478b-bf3c-bed4ccc0feb7q5gnkfxz.img" returned: 0 in 0.749s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.3741ad83-adec-478b-bf3c-bed4ccc0feb7q5gnkfxz.img {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:18 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.3741ad83-adec-478b-bf3c-bed4ccc0feb7q5gnkfxz.img Jun 28 14:33:18 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:18 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.3741ad83-adec-478b-bf3c-bed4ccc0feb7q5gnkfxz.img" returned: 1 in 0.821s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.3741ad83-adec-478b-bf3c-bed4ccc0feb7q5gnkfxz.img' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:33:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.3741ad83-adec-478b-bf3c-bed4ccc0feb7q5gnkfxz.img /opt/stack/data/cinder/conversion/vol_upload_wl3uc76g {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:18 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.3741ad83-adec-478b-bf3c-bed4ccc0feb7q5gnkfxz.img /opt/stack/data/cinder/conversion/vol_upload_wl3uc76g Jun 28 14:33:18 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:19 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.3741ad83-adec-478b-bf3c-bed4ccc0feb7q5gnkfxz.img /opt/stack/data/cinder/conversion/vol_upload_wl3uc76g" returned: 0 in 0.767s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:19 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Image conversion details: src /opt/stack/data/cinder/conversion/8ad2dc66-748f-4b8b-9876-e58e40f86de2.temp_image.3741ad83-adec-478b-bf3c-bed4ccc0feb7q5gnkfxz.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_wl3uc76g {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:33:19 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 28 14:33:19 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[60380d2b-b6f8-4566-beb7-109d6f5217df]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wl3uc76g {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:19 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wl3uc76g Jun 28 14:33:19 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:20 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wl3uc76g" returned: 0 in 0.809s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.631s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Uploaded volume to glance image-id: 3741ad83-adec-478b-bf3c-bed4ccc0feb7. {{(pid=93561) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 28 14:33:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.154s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4fe0dc55-a15b-48a9-940c-4988035f54a2,created_at=2026-06-28T12:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1125184904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fe0dc55-a15b-48a9-940c-4988035f54a2,host='devstack@QuobyteHD#QuobyteHD',id=c6e977f3-07d7-490c-b124-fdc469722378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb80402f803403db228259188db089e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:33:11Z,use_quota=True,user_id='584fdf37202a4aa8b9cee1f2737e7e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9eff4626-9dc1-494e-8d67-5fe5fa135a63),volume_type_id=9eff4626-9dc1-494e-8d67-5fe5fa135a63)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:33:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Creating volume c6e977f3-07d7-490c-b124-fdc469722378 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:33:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:33:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:33:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:33:22 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:33:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:22 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378 1073741824 Jun 28 14:33:22 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:22 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-74579130-9743-4cb4-a873-5df3ac5212b6 tempest-VolumesActionsTest-1814209699 None] Copy volume to image completed successfully. Jun 28 14:33:23 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378 1073741824" returned: 0 in 0.944s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:23 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378 Jun 28 14:33:23 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:23 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378" returned: 0 in 0.726s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:33:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd9e79c-02f0-47e7-9adc-3b146231588e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6e977f3-07d7-490c-b124-fdc469722378', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777a6733-1d35-4ca4-9804-b00b785325d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:24 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Volume volume-c6e977f3-07d7-490c-b124-fdc469722378 (c6e977f3-07d7-490c-b124-fdc469722378): created successfully Jun 28 14:33:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777a6733-1d35-4ca4-9804-b00b785325d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Flow 'volume_create_manager' (01baeae4-7eba-408f-b215-d3f3204320a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:33:24 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-053701a0-49bb-4d0e-968a-c2b558d69933 tempest-GroupSnapshotsTest-2037888235 None] Created volume successfully. Jun 28 14:33:24 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Acquiring lock "cinder-8ad2dc66-748f-4b8b-9876-e58e40f86de2-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:33:24 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Lock "cinder-8ad2dc66-748f-4b8b-9876-e58e40f86de2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:33:24 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Acquiring lock "cinder-quobyte-8ad2dc66-748f-4b8b-9876-e58e40f86de2" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:33:24 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Lock "cinder-quobyte-8ad2dc66-748f-4b8b-9876-e58e40f86de2" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:33:24 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[98055298-e8a5-424a-bc19-b2730571d74d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:24 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 Jun 28 14:33:24 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:25 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c3e2d5d3-3e5b-4d10-91df-e75129d79abf tempest-GroupSnapshotsTest-2037888235 None] Update group completed successfully. Jun 28 14:33:25 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2" returned: 0 in 0.844s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:25 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2 Jun 28 14:33:25 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:25 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8ad2dc66-748f-4b8b-9876-e58e40f86de2" returned: 0 in 0.673s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Lock "cinder-quobyte-8ad2dc66-748f-4b8b-9876-e58e40f86de2" released by "delete_volume" :: held 1.561s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:33:25 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Created reservations ['902e35ed-d484-4b26-a897-9c906ed59409', 'a592efea-8586-4734-bd45-052dc1e8e707', '7407b9e1-0de4-47a2-a782-c7b8963aa7d5', '1d4980aa-2aa4-4903-adc7-068de7aaa45d'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:33:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:25 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:33:25 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:33:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:25 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:33:25 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:26 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a24cd3ee-8f7a-403e-9970-4afc269176a6 tempest-GroupSnapshotsTest-2037888235 None] Update group completed successfully. Jun 28 14:33:26 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.702s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:26 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:33:26 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Deleted volume successfully. Jun 28 14:33:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-548e13dd-a9c0-49b0-b505-1a272b773776 tempest-VolumesActionsTest-1814209699 None] Lock "cinder-8ad2dc66-748f-4b8b-9876-e58e40f86de2-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:33:27 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-55596a15-c288-4c12-9197-d1cd0b903afb tempest-GroupSnapshotsTest-2037888235 None] Update group completed successfully. Jun 28 14:33:28 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-26b4b4fa-9a74-4546-9d58-280fef9917c3 tempest-GroupSnapshotsTest-2037888235 None] Update group completed successfully. Jun 28 14:33:30 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] GroupSnapshot 649b3981-2aa1-491e-9e37-be036cb53112: creating. Jun 28 14:33:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Group snapshot 649b3981-2aa1-491e-9e37-be036cb53112: creating. {{(pid=93561) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 28 14:33:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Creating offline snapshot 0130ed7a-6fe6-4292-84c5-62574ceed024 of volume c6e977f3-07d7-490c-b124-fdc469722378 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:33:30 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85a9379-e2ac-4ed3-8ad3-4986458a727c]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:30 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378 Jun 28 14:33:30 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Flow 'volume_create_manager' (f607f878-0843-4a5a-8da1-646fffe4923d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd86999-c535-4905-8f64-ce693ebcf75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:31 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd86999-c535-4905-8f64-ce693ebcf75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ca4bfe781b452e8b1ba11c9d425fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:33:31Z,use_quota=True,user_id='8fd0b0849a2b40808efec02ea660c737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8240bcbd-0fd5-4e6d-b0b7-a41b3581bb5a),volume_type_id=8240bcbd-0fd5-4e6d-b0b7-a41b3581bb5a)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e83d9f-e734-48bd-944c-990f55542672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e83d9f-e734-48bd-944c-990f55542672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6a35a6-e6e3-4f63-b850-06ffd9babfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG cinder.image.glance [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Creating Keystone auth plugin from conf {{(pid=93561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378" returned: 0 in 0.900s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:31 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024 1G Jun 28 14:33:31 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6a35a6-e6e3-4f63-b850-06ffd9babfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd', 'volume_name': 'volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd', 'volume_size': 1, 'image_id': 'fbd313f1-c6df-4365-8636-7d2ae51ba3db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbd313f1-c6df-4365-8636-7d2ae51ba3db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89b79357d2710fc1e341d1a7ea63769d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13ca4bfe781b452e8b1ba11c9d425fcf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ba318ee287698d6d2fc6c63ea33305fbca1cf8d89c71e17b773e532783149928276ee6da89e1f294562b6b188e45888d8288895d6bb449bc6ebf92c8803feac', 'id': 'fbd313f1-c6df-4365-8636-7d2ae51ba3db', 'created_at': datetime.datetime(2026, 6, 28, 12, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 33, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbd313f1-c6df-4365-8636-7d2ae51ba3db/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404ecf3f-33a1-49ca-8b64-6f43182c5f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404ecf3f-33a1-49ca-8b64-6f43182c5f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60900818-f227-4248-91e0-ee1eacb12d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:31 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Volume 2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd', 'volume_size': 1, 'image_id': 'fbd313f1-c6df-4365-8636-7d2ae51ba3db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbd313f1-c6df-4365-8636-7d2ae51ba3db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89b79357d2710fc1e341d1a7ea63769d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13ca4bfe781b452e8b1ba11c9d425fcf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ba318ee287698d6d2fc6c63ea33305fbca1cf8d89c71e17b773e532783149928276ee6da89e1f294562b6b188e45888d8288895d6bb449bc6ebf92c8803feac', 'id': 'fbd313f1-c6df-4365-8636-7d2ae51ba3db', 'created_at': datetime.datetime(2026, 6, 28, 12, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 33, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbd313f1-c6df-4365-8636-7d2ae51ba3db/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Trying to clone 2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd from image fbd313f1-c6df-4365-8636-7d2ae51ba3db at location (None, [{'url': 'file:///opt/stack/data/glance/images/fbd313f1-c6df-4365-8636-7d2ae51ba3db', 'metadata': {}}]). {{(pid=93561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 28 14:33:31 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Image download 0.00 MB at 0.00 MB/s Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fff9c26-a40a-4af7-be9a-41093052e1a2]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:31 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD Jun 28 14:33:31 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:32 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024 1G" returned: 0 in 0.885s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e977f3-07d7-490c-b124-fdc469722378 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:32 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e977f3-07d7-490c-b124-fdc469722378 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024 Jun 28 14:33:32 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:32 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD" returned: 0 in 0.817s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:32 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD Jun 28 14:33:32 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Flow 'volume_create_manager' (4a216e6f-33c2-4652-ac13-6f2ea36aa6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb0939b-bf0a-4d63-9904-d872c97926ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb0939b-bf0a-4d63-9904-d872c97926ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1569624213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c39288-deea-4203-8164-19ca21a75da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0128ca6a61bd4e2baf6bb39eb8051461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:33:33Z,use_quota=True,user_id='467d509760f44516921f4573869b7a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f153c50c-9462-43ac-8389-6f0e9f94b1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f153c50c-9462-43ac-8389-6f0e9f94b1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac55351-f938-4caa-9c50-e00539a9a397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac55351-f938-4caa-9c50-e00539a9a397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c39288-deea-4203-8164-19ca21a75da2', 'volume_name': 'volume-40c39288-deea-4203-8164-19ca21a75da2', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813651b0-1ee4-40e7-bebf-0db0724caded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813651b0-1ee4-40e7-bebf-0db0724caded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320f3b2a-5edb-4f44-909e-90a1f9a0eb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:32 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Volume 40c39288-deea-4203-8164-19ca21a75da2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c39288-deea-4203-8164-19ca21a75da2', 'volume_size': 1} Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:32 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e977f3-07d7-490c-b124-fdc469722378 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024" returned: 0 in 0.739s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:32 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024 is being set with open permissions: ugo+rw: NotImplementedError Jun 28 14:33:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:32 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024 Jun 28 14:33:32 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:33 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD" returned: 1 in 0.746s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:33:33 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Temporary image fbd313f1-c6df-4365-8636-7d2ae51ba3db is fetched for user 8fd0b0849a2b40808efec02ea660c737. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 28 14:33:33 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba53b26-f5e0-4f3d-9b48-f9869c02a96a]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:33 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD Jun 28 14:33:33 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:33 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024" returned: 0 in 0.661s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:33 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.info Jun 28 14:33:33 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:34 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD" returned: 0 in 0.740s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:34 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.info" returned: 0 in 0.644s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:34 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.info is being set with open permissions: ugo+rw: NotImplementedError Jun 28 14:33:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:34 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.info Jun 28 14:33:34 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:34 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD Jun 28 14:33:34 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:34 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD" returned: 1 in 0.715s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:33:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:34 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.info" returned: 0 in 0.643s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.566s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Creating offline snapshot 6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 of volume 829b3975-5ee0-4182-98df-8e9c1e295a93 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:33:34 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f5f85f-4e05-452e-bdf7-93e9e5b0c1d8]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:34 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93 Jun 28 14:33:34 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:35 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93" returned: 0 in 0.722s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:35 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 1G Jun 28 14:33:35 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:36 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 1G" returned: 0 in 0.765s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-829b3975-5ee0-4182-98df-8e9c1e295a93 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:36 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-829b3975-5ee0-4182-98df-8e9c1e295a93 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 Jun 28 14:33:36 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:37 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-829b3975-5ee0-4182-98df-8e9c1e295a93 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332" returned: 0 in 0.677s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:37 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 is being set with open permissions: ugo+rw: NotImplementedError Jun 28 14:33:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:37 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 Jun 28 14:33:37 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:37 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332" returned: 0 in 0.653s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:37 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.info Jun 28 14:33:37 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:33:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:33:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:33:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:37 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:33:37 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:38 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.info" returned: 0 in 0.643s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:38 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.info is being set with open permissions: ugo+rw: NotImplementedError Jun 28 14:33:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:38 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.info Jun 28 14:33:38 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:38 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.651s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:33:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:33:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 28 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:33:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:33:39 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.info" returned: 0 in 0.663s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.201s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.223s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ca4bfe781b452e8b1ba11c9d425fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:33:31Z,use_quota=True,user_id='8fd0b0849a2b40808efec02ea660c737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8240bcbd-0fd5-4e6d-b0b7-a41b3581bb5a),volume_type_id=8240bcbd-0fd5-4e6d-b0b7-a41b3581bb5a)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Creating volume 2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:33:39 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:39 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd 1073741824 Jun 28 14:33:39 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:39 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f7c8e60f-49e2-4713-a431-3d2660b3005d tempest-GroupSnapshotsTest-2037888235 None] group_snapshot 649b3981-2aa1-491e-9e37-be036cb53112: created successfully Jun 28 14:33:39 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] group_snapshot 649b3981-2aa1-491e-9e37-be036cb53112: deleting Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] group_snapshot 649b3981-2aa1-491e-9e37-be036cb53112: deleting {{(pid=93561) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "cinder-quobyte-c6e977f3-07d7-490c-b124-fdc469722378" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-c6e977f3-07d7-490c-b124-fdc469722378" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "cinder-quobyte-0130ed7a-6fe6-4292-84c5-62574ceed024" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-0130ed7a-6fe6-4292-84c5-62574ceed024" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Deleting offline snapshot 0130ed7a-6fe6-4292-84c5-62574ceed024 of volume c6e977f3-07d7-490c-b124-fdc469722378 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:33:39 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] snapshot_file for this snap is: volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd 1073741824" returned: 0 in 0.872s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f323ef-26cf-439e-a9d3-898d0225f49e]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:40 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd Jun 28 14:33:40 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:40 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024 Jun 28 14:33:40 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:40 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd" returned: 0 in 0.689s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.921s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1569624213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c39288-deea-4203-8164-19ca21a75da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0128ca6a61bd4e2baf6bb39eb8051461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:33:33Z,use_quota=True,user_id='467d509760f44516921f4573869b7a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Creating volume 40c39288-deea-4203-8164-19ca21a75da2 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:33:40 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:40 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 1073741824 Jun 28 14:33:40 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Attempting download of fbd313f1-c6df-4365-8636-7d2ae51ba3db ((None, [{'url': 'file:///opt/stack/data/glance/images/fbd313f1-c6df-4365-8636-7d2ae51ba3db', 'metadata': {}}])) to volume 2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 28 14:33:40 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024" returned: 0 in 0.809s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e977f3-07d7-490c-b124-fdc469722378(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59d66d9-77bc-4ecb-877d-9f434692697f]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57f2c08-d1f5-44ff-bb79-a0a52b90f4d8]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbd313f1-c6df-4365-8636-7d2ae51ba3db_vpa6zxnn {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:40 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378 Jun 28 14:33:40 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:40 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbd313f1-c6df-4365-8636-7d2ae51ba3db_vpa6zxnn Jun 28 14:33:40 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:41 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 1073741824" returned: 0 in 0.922s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:41 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbd313f1-c6df-4365-8636-7d2ae51ba3db_vpa6zxnn" returned: 0 in 0.849s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbd313f1-c6df-4365-8636-7d2ae51ba3db_vpa6zxnn {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:41 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:41 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 Jun 28 14:33:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378" returned: 0 in 0.893s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:41 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:41 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024 Jun 28 14:33:41 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:41 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbd313f1-c6df-4365-8636-7d2ae51ba3db_vpa6zxnn Jun 28 14:33:41 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:42 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2" returned: 0 in 0.683s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:33:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320f3b2a-5edb-4f44-909e-90a1f9a0eb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c39288-deea-4203-8164-19ca21a75da2', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c774c7fd-76c3-4b5f-8542-9e754402b9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:42 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Volume volume-40c39288-deea-4203-8164-19ca21a75da2 (40c39288-deea-4203-8164-19ca21a75da2): created successfully Jun 28 14:33:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c774c7fd-76c3-4b5f-8542-9e754402b9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Flow 'volume_create_manager' (4a216e6f-33c2-4652-ac13-6f2ea36aa6aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:33:42 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-868ab45f-97d4-44f3-8820-5129529db20b tempest-VolumesCloneTest-573483063 None] Created volume successfully. Jun 28 14:33:42 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbd313f1-c6df-4365-8636-7d2ae51ba3db_vpa6zxnn" returned: 1 in 0.763s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbd313f1-c6df-4365-8636-7d2ae51ba3db_vpa6zxnn' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:33:42 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4456fb86-4e7b-4259-af78-2f8427944f09]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:42 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024" returned: 0 in 0.779s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:42 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024 Jun 28 14:33:42 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:42 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD Jun 28 14:33:42 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:43 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378.0130ed7a-6fe6-4292-84c5-62574ceed024" returned: 0 in 0.646s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD" returned: 0 in 0.714s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:43 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-0130ed7a-6fe6-4292-84c5-62574ceed024" released by "_delete_snapshot" :: held 3.279s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-c6e977f3-07d7-490c-b124-fdc469722378" released by "delete_snapshot" :: held 3.307s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "cinder-quobyte-829b3975-5ee0-4182-98df-8e9c1e295a93" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-829b3975-5ee0-4182-98df-8e9c1e295a93" acquired by "delete_snapshot" :: waited 0.013s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "cinder-quobyte-6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Deleting offline snapshot 6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 of volume 829b3975-5ee0-4182-98df-8e9c1e295a93 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] snapshot_file for this snap is: volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[51990160-703f-410f-b2ed-723812af733d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:43 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD Jun 28 14:33:43 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:43 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 Jun 28 14:33:43 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Flow 'volume_create_manager' (fb82698b-a77b-49ae-b88c-3089f350537f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871d4ec1-40da-44d0-9cb4-227a8a466c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871d4ec1-40da-44d0-9cb4-227a8a466c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-276986200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2507e75-baad-4b1b-9268-9424c84759b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0128ca6a61bd4e2baf6bb39eb8051461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:33:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=40c39288-deea-4203-8164-19ca21a75da2,status='creating',terminated_at=None,updated_at=2026-06-28T12:33:44Z,use_quota=True,user_id='467d509760f44516921f4573869b7a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2f2872-0ea9-4ff0-b023-cbd6f836599c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2f2872-0ea9-4ff0-b023-cbd6f836599c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92495b48-fa79-4269-9c6e-436c7159951a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92495b48-fa79-4269-9c6e-436c7159951a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd2507e75-baad-4b1b-9268-9424c84759b4', 'volume_name': 'volume-d2507e75-baad-4b1b-9268-9424c84759b4', 'volume_size': 2, 'source_volid': '40c39288-deea-4203-8164-19ca21a75da2', 'source_volstatus': 'available'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7f207a-7897-4ba2-99f3-6084d943c175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7f207a-7897-4ba2-99f3-6084d943c175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c56bdf-cbd1-4a04-a482-d1179981966e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:43 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Volume d2507e75-baad-4b1b-9268-9424c84759b4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d2507e75-baad-4b1b-9268-9424c84759b4', 'volume_size': 2, 'source_volid': '40c39288-deea-4203-8164-19ca21a75da2', 'source_volstatus': 'available'} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:43 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Cloning volume 40c39288-deea-4203-8164-19ca21a75da2 to volume d2507e75-baad-4b1b-9268-9424c84759b4 Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Creating offline snapshot b004a769-867c-4638-a166-b0286207955b of volume 40c39288-deea-4203-8164-19ca21a75da2 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:33:43 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD" returned: 1 in 0.804s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] fbd313f1-c6df-4365-8636-7d2ae51ba3db was raw, converting to raw {{(pid=93561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5351f05e-275c-42eb-b2e9-348933380ffc]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:44 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd Jun 28 14:33:44 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:44 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332" returned: 0 in 0.811s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-829b3975-5ee0-4182-98df-8e9c1e295a93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:33:44 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 Jun 28 14:33:44 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:44 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e094c5-df90-46ad-9389-2283c79d59d0]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:44 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93 Jun 28 14:33:44 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:44 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd" returned: 0 in 0.799s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:44 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fbd313f1-c6df-4365-8636-7d2ae51ba3db_h9qr5jlbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:33:44 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Converted 0.00 MB image at 0.00 MB/s Jun 28 14:33:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:44 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2" returned: 0 in 0.803s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:44 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd 1G Jun 28 14:33:44 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:44 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b 1G Jun 28 14:33:44 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:44 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93" returned: 0 in 0.822s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:44 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 Jun 28 14:33:44 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:45 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd 1G" returned: 0 in 0.697s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:45 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf29ef9f-0dd3-485e-ac4f-575cca3db082]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:45 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b 1G" returned: 0 in 0.845s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c39288-deea-4203-8164-19ca21a75da2 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:45 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd Jun 28 14:33:45 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:45 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c39288-deea-4203-8164-19ca21a75da2 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b Jun 28 14:33:45 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:45 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332" returned: 0 in 0.782s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:45 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332 Jun 28 14:33:45 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:46 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd" returned: 0 in 0.797s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:46 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c39288-deea-4203-8164-19ca21a75da2 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b" returned: 0 in 0.704s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:46 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b is being set with open permissions: ugo+rw Jun 28 14:33:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:46 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b Jun 28 14:33:46 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:46 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd Jun 28 14:33:46 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:46 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93.6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332" returned: 0 in 0.703s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-6bfb1eb2-e5e7-4d1c-8756-921b7eaf9332" released by "_delete_snapshot" :: held 3.255s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:33:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-829b3975-5ee0-4182-98df-8e9c1e295a93" released by "delete_snapshot" :: held 3.279s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:33:46 devstack cinder-volume[93561]: WARNING cinder.quota [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-779812283 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-779812283, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:33:46 devstack cinder-volume[93561]: WARNING cinder.quota [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-779812283 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-779812283, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:33:46 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Created reservations ['e22489bc-a7ee-4a38-9454-385afcc2edab', 'bfc34785-4ef2-4cc7-a0e9-95ded2895679', 'b106184b-0643-473d-9478-c518d75a895a', '14b3260f-a52b-4a1d-9140-b7806eae616a'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:33:46 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] Created reservations ['5683167f-dc25-4b82-8612-3c2b51d09227', '2e48f090-98db-46b8-a3f8-bce94172dc06', 'd81038fc-6fa2-4eca-80dc-55d597637c1a', '7a9426bf-b96d-4d17-a1ee-34f136ce9249'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:33:46 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e31b7aaa-a388-475b-8eee-3774d81db2c8 tempest-GroupSnapshotsTest-2037888235 None] group_snapshot 649b3981-2aa1-491e-9e37-be036cb53112: deleted successfully Jun 28 14:33:47 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b" returned: 0 in 0.652s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:47 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.info Jun 28 14:33:47 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:47 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd" returned: 1 in 0.781s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Downloaded image fbd313f1-c6df-4365-8636-7d2ae51ba3db ((None, [{'url': 'file:///opt/stack/data/glance/images/fbd313f1-c6df-4365-8636-7d2ae51ba3db', 'metadata': {}}])) to volume 2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd successfully. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Temporary image fbd313f1-c6df-4365-8636-7d2ae51ba3db for user 8fd0b0849a2b40808efec02ea660c737 is deleted. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Marking volume 2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd as bootable. {{(pid=93561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Copying metadata from image fbd313f1-c6df-4365-8636-7d2ae51ba3db to 2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd. {{(pid=93561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Creating volume glance metadata for volume 2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd backed by image fbd313f1-c6df-4365-8636-7d2ae51ba3db with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fbd313f1-c6df-4365-8636-7d2ae51ba3db', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '89b79357d2710fc1e341d1a7ea63769d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60900818-f227-4248-91e0-ee1eacb12d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd', 'volume_size': 1, 'image_id': 'fbd313f1-c6df-4365-8636-7d2ae51ba3db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbd313f1-c6df-4365-8636-7d2ae51ba3db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89b79357d2710fc1e341d1a7ea63769d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13ca4bfe781b452e8b1ba11c9d425fcf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ba318ee287698d6d2fc6c63ea33305fbca1cf8d89c71e17b773e532783149928276ee6da89e1f294562b6b188e45888d8288895d6bb449bc6ebf92c8803feac', 'id': 'fbd313f1-c6df-4365-8636-7d2ae51ba3db', 'created_at': datetime.datetime(2026, 6, 28, 12, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 33, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbd313f1-c6df-4365-8636-7d2ae51ba3db/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4db4308-4bda-43bd-870b-85d9f9c19960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:47 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Volume volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd (2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd): created successfully Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4db4308-4bda-43bd-870b-85d9f9c19960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Flow 'volume_create_manager' (f607f878-0843-4a5a-8da1-646fffe4923d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:33:47 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-4b970cfa-53be-416e-8def-cc4a3bcdb7bc tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Created volume successfully. Jun 28 14:33:47 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.info" returned: 0 in 0.657s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:47 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.info is being set with open permissions: ugo+rw Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:47 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.info Jun 28 14:33:47 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "cinder-quobyte-829b3975-5ee0-4182-98df-8e9c1e295a93" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-829b3975-5ee0-4182-98df-8e9c1e295a93" acquired by "delete_volume" :: waited 0.024s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a4219d-fe7b-4d3e-b994-c420157d0c1e]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:48 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93 Jun 28 14:33:48 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Acquiring lock "cinder-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Lock "cinder-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Acquiring lock "cinder-quobyte-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Lock "cinder-quobyte-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[535dc05d-87f5-4f59-82c5-1b8181c817e6]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:48 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.info" returned: 0 in 0.687s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:48 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd Jun 28 14:33:48 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Acquiring lock "cinder-quobyte-d2507e75-baad-4b1b-9268-9424c84759b4" by "_copy_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Lock "cinder-quobyte-d2507e75-baad-4b1b-9268-9424c84759b4" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] snapshot: b004a769-867c-4638-a166-b0286207955b, volume: d2507e75-baad-4b1b-9268-9424c84759b4, {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fce54b6-9148-4c39-a38a-cdd42862201a]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:48 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b Jun 28 14:33:48 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:48 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93" returned: 0 in 0.845s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:48 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93 Jun 28 14:33:48 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:49 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd" returned: 0 in 0.816s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:49 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd Jun 28 14:33:49 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:49 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b" returned: 0 in 0.816s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c39288-deea-4203-8164-19ca21a75da2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Creating direct copy from snapshot {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66599de-3ae2-4930-8b4e-5d44ab003389]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:49 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 Jun 28 14:33:49 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:49 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-829b3975-5ee0-4182-98df-8e9c1e295a93" returned: 0 in 0.684s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-829b3975-5ee0-4182-98df-8e9c1e295a93" released by "delete_volume" :: held 1.616s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "cinder-quobyte-c6e977f3-07d7-490c-b124-fdc469722378" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-c6e977f3-07d7-490c-b124-fdc469722378" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22df117-7225-4108-b162-079c8018e180]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:49 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378 Jun 28 14:33:49 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:49 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd" returned: 1 in 0.809s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:33:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:49 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd Jun 28 14:33:49 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:50 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2" returned: 0 in 0.790s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:50 devstack cinder-volume[93561]: DEBUG cinder.utils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Path /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d2507e75-baad-4b1b-9268-9424c84759b4 not found in is_blk_device check {{(pid=93561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 28 14:33:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d2507e75-baad-4b1b-9268-9424c84759b4 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:50 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d2507e75-baad-4b1b-9268-9424c84759b4 Jun 28 14:33:50 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:50 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378" returned: 0 in 0.845s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:50 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378 Jun 28 14:33:50 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:50 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd" returned: 0 in 0.708s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Lock "cinder-quobyte-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd" released by "delete_volume" :: held 2.418s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:33:50 devstack cinder-volume[93561]: WARNING cinder.quota [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:33:50 devstack cinder-volume[93561]: WARNING cinder.quota [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:33:50 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Created reservations ['9ae5ae13-95d9-41be-afab-62c8640f2ec7', '08b0e1e7-1712-4402-a8d0-72f1453c3337', '56b00a07-f141-4557-90be-d3cce7d1afcb', '7d895379-d458-4101-80aa-b3997619c218'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:33:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:33:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:33:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:50 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:33:50 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:51 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c6e977f3-07d7-490c-b124-fdc469722378" returned: 0 in 0.860s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-c6e977f3-07d7-490c-b124-fdc469722378" released by "delete_volume" :: held 1.793s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:33:51 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Created reservations ['063f20d3-cf73-41ac-bb80-cbb37fe966cb'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:33:51 devstack cinder-volume[93561]: WARNING cinder.quota [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-779812283 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-779812283, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:33:51 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Created reservations ['7c54bef9-dc85-44fd-a43d-ba270370db07', '4597b041-e5b6-41b7-aa5a-2c3d1f6adaf7', 'fe0667dc-8aa2-4d60-882b-6795e8b95bc0', '59931193-727c-4c3c-b46c-1c255ca77e33'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:33:52 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Created reservations ['1199758e-00bd-4b56-94db-8f8879e419e4', '312ef19d-c05b-4d12-a0d0-bdc6c4c5cc69', 'eb108947-fc63-4f85-ac66-32d12c713939', '1840a3e0-4c69-4f17-80ae-9eb69cbf8549'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:33:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:33:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:33:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:33:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:33:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:52 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:33:52 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:52 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.912s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:52 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:33:52 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Deleted volume successfully. Jun 28 14:33:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cbfd93cc-9900-4504-884e-b80f451d544d tempest-VolumeAndVolumeTypeFromImageTest-1035590118 None] Lock "cinder-2a8ca72f-25f6-4d2e-acc0-66e60fb27dcd-delete_volume" released by "delete_volume" :: held 4.587s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:33:53 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.332s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:53 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:33:53 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-2e8c266d-6b3f-470f-85c3-4474f738a6d2 tempest-GroupSnapshotsTest-2037888235 None] Delete group completed successfully. Jun 28 14:33:54 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7b3b324b-576e-4f51-96de-82afc00ae026 tempest-GroupSnapshotsTest-2037888235 None] Group tempest-GroupSnapshotsTest-Group-903376876: creating Jun 28 14:33:54 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7b3b324b-576e-4f51-96de-82afc00ae026 tempest-GroupSnapshotsTest-2037888235 None] Group tempest-GroupSnapshotsTest-Group-903376876: created successfully Jun 28 14:33:54 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7b3b324b-576e-4f51-96de-82afc00ae026 tempest-GroupSnapshotsTest-2037888235 None] Create group completed successfully. Jun 28 14:33:56 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d2507e75-baad-4b1b-9268-9424c84759b4" returned: 0 in 6.171s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:56 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[496453b9-e5f1-4904-8505-b28fd0af5927]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:56 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 Jun 28 14:33:56 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:56 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:33:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Flow 'volume_create_manager' (8350b306-16c0-42f3-9edf-6551fc6fb01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:33:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c44ca6d-b951-4c95-afdb-57d764083f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c44ca6d-b951-4c95-afdb-57d764083f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1584273278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f2e73c9c-ee3e-4461-a810-97f1ef2fa9ce,host='devstack@QuobyteHD#QuobyteHD',id=2dccaa83-2d9a-436f-88e5-63e3ff7a0a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb80402f803403db228259188db089e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:33:56Z,use_quota=True,user_id='584fdf37202a4aa8b9cee1f2737e7e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a443c28a-e3c5-4349-bc75-ac2a1244315a),volume_type_id=a443c28a-e3c5-4349-bc75-ac2a1244315a)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc4dd67-4816-4f01-8146-6b009fe3ba28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc4dd67-4816-4f01-8146-6b009fe3ba28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0102e288-4620-40d4-83ee-d2bc76c6e738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0102e288-4620-40d4-83ee-d2bc76c6e738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dccaa83-2d9a-436f-88e5-63e3ff7a0a56', 'volume_name': 'volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5621f01b-e4b9-42c9-97d5-70cfb6df18a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5621f01b-e4b9-42c9-97d5-70cfb6df18a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fda87e7-a89c-429a-91e0-a33858b2ecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:56 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Volume 2dccaa83-2d9a-436f-88e5-63e3ff7a0a56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56', 'volume_size': 1} Jun 28 14:33:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:57 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2" returned: 0 in 1.004s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:57 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Image conversion details: src /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d2507e75-baad-4b1b-9268-9424c84759b4 {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:33:57 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Converted 1024.00 MB image at 165.90 MB/s Jun 28 14:33:57 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d2507e75-baad-4b1b-9268-9424c84759b4 is being set with open permissions: ugo+rw Jun 28 14:33:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d2507e75-baad-4b1b-9268-9424c84759b4 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:57 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d2507e75-baad-4b1b-9268-9424c84759b4 Jun 28 14:33:57 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:57 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d2507e75-baad-4b1b-9268-9424c84759b4" returned: 0 in 0.642s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Lock "cinder-quobyte-d2507e75-baad-4b1b-9268-9424c84759b4" released by "_copy_volume_from_snapshot" :: held 9.521s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:33:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Acquiring lock "cinder-quobyte-b004a769-867c-4638-a166-b0286207955b" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:33:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Lock "cinder-quobyte-b004a769-867c-4638-a166-b0286207955b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:33:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Deleting offline snapshot b004a769-867c-4638-a166-b0286207955b of volume 40c39288-deea-4203-8164-19ca21a75da2 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:33:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] snapshot_file for this snap is: volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:33:58 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bbd684-e505-4de8-be3c-2d8000af4e25]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:58 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b Jun 28 14:33:58 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:58 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b" returned: 0 in 0.757s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c39288-deea-4203-8164-19ca21a75da2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:33:58 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3d08bb-130b-46d9-b01a-fd6f531dd5f0]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:33:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:58 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 Jun 28 14:33:58 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Flow 'volume_create_manager' (b4b2bd1c-ced9-4afa-b33a-c3c651fa1b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b21f15-37c3-4273-ba2c-b02b5a162c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b21f15-37c3-4273-ba2c-b02b5a162c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-308535983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54023bf5-a127-4942-8187-be904ab89ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d80fe98a6642c5b54622190c63a7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:33:59Z,use_quota=True,user_id='3b780287c2eb4688a37d0d1b7bbe4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01a21d7-77b3-48ff-ad16-c775c99b1a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01a21d7-77b3-48ff-ad16-c775c99b1a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29342e16-4203-435c-a9c0-fe0177fd1ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29342e16-4203-435c-a9c0-fe0177fd1ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54023bf5-a127-4942-8187-be904ab89ec3', 'volume_name': 'volume-54023bf5-a127-4942-8187-be904ab89ec3', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa9e6b7-275d-4221-a193-d0c0c9725ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa9e6b7-275d-4221-a193-d0c0c9725ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bfc01b1-1447-4351-a7a6-3d5570787ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:59 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Volume 54023bf5-a127-4942-8187-be904ab89ec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54023bf5-a127-4942-8187-be904ab89ec3', 'volume_size': 1} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Flow 'volume_create_manager' (6879eb08-95a9-4511-a1e4-909e6682ea0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07957e77-353f-42d7-bf4b-49ed96953548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07957e77-353f-42d7-bf4b-49ed96953548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1526066044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df5d18b-caaf-4e4a-b863-6d066bf637ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d80fe98a6642c5b54622190c63a7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:33:59Z,use_quota=True,user_id='3b780287c2eb4688a37d0d1b7bbe4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03faa2ad-9a87-47b5-b235-43aeb4524053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03faa2ad-9a87-47b5-b235-43aeb4524053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2c969d-acd1-4e79-b51b-615cd5f5456a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2c969d-acd1-4e79-b51b-615cd5f5456a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0df5d18b-caaf-4e4a-b863-6d066bf637ee', 'volume_name': 'volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413860a2-e7ed-4057-a20f-23c5eba7a8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413860a2-e7ed-4057-a20f-23c5eba7a8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9fbc08-0f52-4f26-8f7c-bf210ab24b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:59 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Volume 0df5d18b-caaf-4e4a-b863-6d066bf637ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee', 'volume_size': 1} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:33:59 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2" returned: 0 in 0.815s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:33:59 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b Jun 28 14:33:59 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Flow 'volume_create_manager' (6021e5b1-c74f-4261-8adc-c73427256746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3b68b6-d3f9-41f1-a5fc-54c0c42efe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3b68b6-d3f9-41f1-a5fc-54c0c42efe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-398386450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc98df1-cab7-4c5c-a61b-20757c85c464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d80fe98a6642c5b54622190c63a7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:00Z,use_quota=True,user_id='3b780287c2eb4688a37d0d1b7bbe4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94afcdb-f0cb-4e6e-80d1-6d511793b1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94afcdb-f0cb-4e6e-80d1-6d511793b1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ecfa77-051b-4817-9745-258328293693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ecfa77-051b-4817-9745-258328293693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffc98df1-cab7-4c5c-a61b-20757c85c464', 'volume_name': 'volume-ffc98df1-cab7-4c5c-a61b-20757c85c464', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4d0563-9c68-4277-bd06-1937e33032fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4d0563-9c68-4277-bd06-1937e33032fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1990eee-b2b8-491d-b9fa-d52d32b60616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:33:59 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Volume ffc98df1-cab7-4c5c-a61b-20757c85c464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffc98df1-cab7-4c5c-a61b-20757c85c464', 'volume_size': 1} Jun 28 14:33:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Flow 'volume_create_manager' (f9dce601-9116-4a22-8770-6a4732950182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce00cb08-a32d-47d9-a007-d001073c821c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce00cb08-a32d-47d9-a007-d001073c821c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-976091080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8da496-c335-4c98-b0f4-57775adccb3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d80fe98a6642c5b54622190c63a7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:00Z,use_quota=True,user_id='3b780287c2eb4688a37d0d1b7bbe4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5122041-677f-4dc9-89e0-c1c8a6f9a701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5122041-677f-4dc9-89e0-c1c8a6f9a701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef76745e-4420-4c67-8c38-4532b919390d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef76745e-4420-4c67-8c38-4532b919390d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f8da496-c335-4c98-b0f4-57775adccb3b', 'volume_name': 'volume-7f8da496-c335-4c98-b0f4-57775adccb3b', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcea8c6-4cd9-4d67-a0c4-89198849a10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcea8c6-4cd9-4d67-a0c4-89198849a10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c4492b-bf71-4eff-9002-7b3ae6d71560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:00 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Volume 7f8da496-c335-4c98-b0f4-57775adccb3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f8da496-c335-4c98-b0f4-57775adccb3b', 'volume_size': 1} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:00 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b" returned: 0 in 0.805s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:00 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b Jun 28 14:34:00 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Flow 'volume_create_manager' (007ca116-5c23-46b4-a05b-49d5f9399c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3256771c-ec82-4603-b2ee-ade2956a6f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3256771c-ec82-4603-b2ee-ade2956a6f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-126844234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc63a3a-21c5-45e7-8e40-1514e6616a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d80fe98a6642c5b54622190c63a7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:01Z,use_quota=True,user_id='3b780287c2eb4688a37d0d1b7bbe4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af06ffaf-f75c-4d69-99a3-55347ce41154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af06ffaf-f75c-4d69-99a3-55347ce41154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41adc89-bf7f-4260-8945-dafbc609dee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41adc89-bf7f-4260-8945-dafbc609dee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc63a3a-21c5-45e7-8e40-1514e6616a65', 'volume_name': 'volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2293c36-1410-43ea-ae95-4679e7495ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2293c36-1410-43ea-ae95-4679e7495ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff93e887-97c7-41cf-a073-f2c700a699f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:00 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Volume fbc63a3a-21c5-45e7-8e40-1514e6616a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65', 'volume_size': 1} Jun 28 14:34:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:01 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2.b004a769-867c-4638-a166-b0286207955b" returned: 0 in 0.646s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Lock "cinder-quobyte-b004a769-867c-4638-a166-b0286207955b" released by "_delete_snapshot" :: held 3.120s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.193s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.498s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f2e73c9c-ee3e-4461-a810-97f1ef2fa9ce,created_at=2026-06-28T12:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1584273278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f2e73c9c-ee3e-4461-a810-97f1ef2fa9ce,host='devstack@QuobyteHD#QuobyteHD',id=2dccaa83-2d9a-436f-88e5-63e3ff7a0a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb80402f803403db228259188db089e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:33:56Z,use_quota=True,user_id='584fdf37202a4aa8b9cee1f2737e7e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a443c28a-e3c5-4349-bc75-ac2a1244315a),volume_type_id=a443c28a-e3c5-4349-bc75-ac2a1244315a)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Creating volume 2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:34:01 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c56bdf-cbd1-4a04-a482-d1179981966e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2507e75-baad-4b1b-9268-9424c84759b4', 'volume_size': 2, 'source_volid': '40c39288-deea-4203-8164-19ca21a75da2', 'source_volstatus': 'available'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:01 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 1073741824 Jun 28 14:34:01 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bfd2a6-b3ae-4e24-94bb-9e1f466302b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:01 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Volume volume-d2507e75-baad-4b1b-9268-9424c84759b4 (d2507e75-baad-4b1b-9268-9424c84759b4): created successfully Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bfd2a6-b3ae-4e24-94bb-9e1f466302b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Flow 'volume_create_manager' (fb82698b-a77b-49ae-b88c-3089f350537f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:01 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e0cec99b-950e-4569-842a-d9f3b2aca2eb tempest-VolumesCloneTest-573483063 None] Created volume successfully. Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Acquiring lock "cinder-d2507e75-baad-4b1b-9268-9424c84759b4-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Lock "cinder-d2507e75-baad-4b1b-9268-9424c84759b4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Acquiring lock "cinder-quobyte-d2507e75-baad-4b1b-9268-9424c84759b4" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Lock "cinder-quobyte-d2507e75-baad-4b1b-9268-9424c84759b4" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46b5150-51e5-48c9-9521-ed0e20737bda]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d2507e75-baad-4b1b-9268-9424c84759b4 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:01 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d2507e75-baad-4b1b-9268-9424c84759b4 Jun 28 14:34:01 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:02 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 1073741824" returned: 0 in 0.871s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:02 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 Jun 28 14:34:02 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:02 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d2507e75-baad-4b1b-9268-9424c84759b4" returned: 0 in 0.781s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d2507e75-baad-4b1b-9268-9424c84759b4 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:02 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d2507e75-baad-4b1b-9268-9424c84759b4 Jun 28 14:34:02 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:02 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56" returned: 0 in 0.642s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.435s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-308535983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54023bf5-a127-4942-8187-be904ab89ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d80fe98a6642c5b54622190c63a7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:33:59Z,use_quota=True,user_id='3b780287c2eb4688a37d0d1b7bbe4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Creating volume 54023bf5-a127-4942-8187-be904ab89ec3 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:34:02 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-54023bf5-a127-4942-8187-be904ab89ec3 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=87,cinder:INSERT=30,cinder:UPDATE=85,cinder:DELETE=4 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:34:02 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-54023bf5-a127-4942-8187-be904ab89ec3 1073741824 Jun 28 14:34:02 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fda87e7-a89c-429a-91e0-a33858b2ecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4826a09e-13da-48a3-b97a-8dda85994e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=87,cinder:UPDATE=90,cinder:INSERT=19,cinder:DELETE=4 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:34:02 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Volume volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 (2dccaa83-2d9a-436f-88e5-63e3ff7a0a56): created successfully Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4826a09e-13da-48a3-b97a-8dda85994e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Flow 'volume_create_manager' (8350b306-16c0-42f3-9edf-6551fc6fb01b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:02 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e3fd2218-d036-40f8-a7d6-c7d10df6a447 tempest-GroupSnapshotsTest-2037888235 None] Created volume successfully. Jun 28 14:34:03 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d2507e75-baad-4b1b-9268-9424c84759b4" returned: 0 in 0.654s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:03 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Lock "cinder-quobyte-d2507e75-baad-4b1b-9268-9424c84759b4" released by "delete_volume" :: held 1.484s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:03 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Created reservations ['64234033-a48a-4c27-ac09-b77f9b5b4f1d', 'bc366a86-a6da-4653-9d35-6ecd38710371', '9f421dca-7b71-4323-928f-99f4ed01ea64', 'c41d6f1d-ef5c-4b39-8b20-b4cefbbe82da'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:03 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:34:03 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:03 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-54023bf5-a127-4942-8187-be904ab89ec3 1073741824" returned: 0 in 0.815s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-54023bf5-a127-4942-8187-be904ab89ec3 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:03 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-54023bf5-a127-4942-8187-be904ab89ec3 Jun 28 14:34:03 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:03 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Acquiring lock "cinder-40c39288-deea-4203-8164-19ca21a75da2-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:03 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] GroupSnapshot f2ed9072-e97d-4a2c-9de2-5bc9570ffce2: creating. Jun 28 14:34:03 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Lock "cinder-40c39288-deea-4203-8164-19ca21a75da2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] Group snapshot f2ed9072-e97d-4a2c-9de2-5bc9570ffce2: creating. {{(pid=93561) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Acquiring lock "cinder-quobyte-40c39288-deea-4203-8164-19ca21a75da2" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Lock "cinder-quobyte-40c39288-deea-4203-8164-19ca21a75da2" acquired by "delete_volume" :: waited 0.020s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:04 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.806s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:34:04 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Deleted volume successfully. Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa774bdd-3edc-47b4-9855-ebea752e19d6]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7454516f-e9b5-4069-9380-0211dffbe6fd tempest-VolumesCloneTest-573483063 None] Lock "cinder-d2507e75-baad-4b1b-9268-9424c84759b4-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:04 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 Jun 28 14:34:04 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:04 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-54023bf5-a127-4942-8187-be904ab89ec3" returned: 0 in 0.707s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.677s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1526066044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df5d18b-caaf-4e4a-b863-6d066bf637ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d80fe98a6642c5b54622190c63a7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:33:59Z,use_quota=True,user_id='3b780287c2eb4688a37d0d1b7bbe4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Creating volume 0df5d18b-caaf-4e4a-b863-6d066bf637ee {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:34:04 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bfc01b1-1447-4351-a7a6-3d5570787ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54023bf5-a127-4942-8187-be904ab89ec3', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:04 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee 1073741824 Jun 28 14:34:04 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b5f459-eb97-470d-89dd-f47bceac2308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:04 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Volume volume-54023bf5-a127-4942-8187-be904ab89ec3 (54023bf5-a127-4942-8187-be904ab89ec3): created successfully Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b5f459-eb97-470d-89dd-f47bceac2308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Flow 'volume_create_manager' (b4b2bd1c-ced9-4afa-b33a-c3c651fa1b53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:04 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-6ca148d6-6c87-47a5-9514-4350526b5c39 tempest-CreateVolumesFromImageTest-359001968 None] Created volume successfully. Jun 28 14:34:04 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2" returned: 0 in 0.804s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:04 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2 Jun 28 14:34:04 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:05 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee 1073741824" returned: 0 in 0.876s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:05 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee Jun 28 14:34:05 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:05 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-40c39288-deea-4203-8164-19ca21a75da2" returned: 0 in 0.658s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Lock "cinder-quobyte-40c39288-deea-4203-8164-19ca21a75da2" released by "delete_volume" :: held 1.539s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Created reservations ['ac237108-69d8-4ed3-aae7-cf568e6fc008', 'e6fff180-f5c9-4205-8058-85074ef31468', '21b7ee6a-4512-440f-9d7c-b2acc9e265c9', '9e733725-fed8-4afb-ab1d-c86046446889'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:05 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:34:05 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:05 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee" returned: 0 in 0.666s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.914s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-398386450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc98df1-cab7-4c5c-a61b-20757c85c464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d80fe98a6642c5b54622190c63a7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:00Z,use_quota=True,user_id='3b780287c2eb4688a37d0d1b7bbe4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Creating volume ffc98df1-cab7-4c5c-a61b-20757c85c464 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:34:05 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ffc98df1-cab7-4c5c-a61b-20757c85c464 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9fbc08-0f52-4f26-8f7c-bf210ab24b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:05 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ffc98df1-cab7-4c5c-a61b-20757c85c464 1073741824 Jun 28 14:34:05 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c1e705-d06f-45c7-a9c2-631545518669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:05 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Volume volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee (0df5d18b-caaf-4e4a-b863-6d066bf637ee): created successfully Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c1e705-d06f-45c7-a9c2-631545518669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:05 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Flow 'volume_create_manager' (6879eb08-95a9-4511-a1e4-909e6682ea0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:05 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-99eabdcd-656d-422a-9c84-f34c0efdfedf tempest-CreateVolumesFromImageTest-359001968 None] Created volume successfully. Jun 28 14:34:06 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.684s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:06 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:34:06 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Deleted volume successfully. Jun 28 14:34:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ae1e61f-ad80-4d85-8caa-8bcaa44d10b2 tempest-VolumesCloneTest-573483063 None] Lock "cinder-40c39288-deea-4203-8164-19ca21a75da2-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:06 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ffc98df1-cab7-4c5c-a61b-20757c85c464 1073741824" returned: 0 in 0.877s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ffc98df1-cab7-4c5c-a61b-20757c85c464 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:06 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ffc98df1-cab7-4c5c-a61b-20757c85c464 Jun 28 14:34:06 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:07 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ffc98df1-cab7-4c5c-a61b-20757c85c464" returned: 0 in 0.686s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.154s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-976091080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8da496-c335-4c98-b0f4-57775adccb3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d80fe98a6642c5b54622190c63a7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:00Z,use_quota=True,user_id='3b780287c2eb4688a37d0d1b7bbe4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Creating volume 7f8da496-c335-4c98-b0f4-57775adccb3b {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:34:07 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7f8da496-c335-4c98-b0f4-57775adccb3b 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:07 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7f8da496-c335-4c98-b0f4-57775adccb3b 1073741824 Jun 28 14:34:07 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1990eee-b2b8-491d-b9fa-d52d32b60616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffc98df1-cab7-4c5c-a61b-20757c85c464', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7990ae11-350e-4cc6-9cd2-f42f66689cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:07 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Volume volume-ffc98df1-cab7-4c5c-a61b-20757c85c464 (ffc98df1-cab7-4c5c-a61b-20757c85c464): created successfully Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7990ae11-350e-4cc6-9cd2-f42f66689cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:07 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Flow 'volume_create_manager' (6021e5b1-c74f-4261-8adc-c73427256746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:07 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-9d25b2ca-3bf3-43be-89ae-03d3c29c1717 tempest-CreateVolumesFromImageTest-359001968 None] Created volume successfully. Jun 28 14:34:08 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7f8da496-c335-4c98-b0f4-57775adccb3b 1073741824" returned: 0 in 0.885s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7f8da496-c335-4c98-b0f4-57775adccb3b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:08 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7f8da496-c335-4c98-b0f4-57775adccb3b Jun 28 14:34:08 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:09 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7f8da496-c335-4c98-b0f4-57775adccb3b" returned: 0 in 0.667s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.443s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-126844234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc63a3a-21c5-45e7-8e40-1514e6616a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d80fe98a6642c5b54622190c63a7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:01Z,use_quota=True,user_id='3b780287c2eb4688a37d0d1b7bbe4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Creating volume fbc63a3a-21c5-45e7-8e40-1514e6616a65 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:34:09 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:09 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65 1073741824 Jun 28 14:34:09 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c4492b-bf71-4eff-9002-7b3ae6d71560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8da496-c335-4c98-b0f4-57775adccb3b', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6deab57-c090-4804-8f62-ed992a1ab3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Flow 'volume_create_manager' (1b71f54a-cfd4-4496-9fbf-342c3bfc48cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4642b7b-df5e-4f1e-8ec4-54866bb8b753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4642b7b-df5e-4f1e-8ec4-54866bb8b753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-492579773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaf8a1b-2a6a-4f02-87f2-3cf966521c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e6bc5bbc414165b0f3144f6773980e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:09Z,use_quota=True,user_id='92fa764e8c4a47bcbc59f8bc7025e5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8574266-9502-43a1-ad9c-dc1458470428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8574266-9502-43a1-ad9c-dc1458470428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a22f8c-31bd-4883-8e68-344ab24638f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a22f8c-31bd-4883-8e68-344ab24638f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acaf8a1b-2a6a-4f02-87f2-3cf966521c2f', 'volume_name': 'volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f', 'volume_size': 2}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57f0196-e515-4f8e-adae-66f820e6d234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57f0196-e515-4f8e-adae-66f820e6d234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7759896-7480-4299-9a32-04d4b0b34d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:09 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Volume acaf8a1b-2a6a-4f02-87f2-3cf966521c2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f', 'volume_size': 2} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:09 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Volume volume-7f8da496-c335-4c98-b0f4-57775adccb3b (7f8da496-c335-4c98-b0f4-57775adccb3b): created successfully Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6deab57-c090-4804-8f62-ed992a1ab3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Flow 'volume_create_manager' (f9dce601-9116-4a22-8770-6a4732950182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:09 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a3d0073d-ff6c-4156-879a-b428d89e779e tempest-CreateVolumesFromImageTest-359001968 None] Created volume successfully. Jun 28 14:34:09 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65 1073741824" returned: 0 in 0.810s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:09 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65 Jun 28 14:34:09 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:10 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65" returned: 0 in 0.641s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:10 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:34:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.581s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:10 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] Creating offline snapshot 5c007f1e-6924-45c4-a28c-6488a1af975c of volume 2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:34:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff93e887-97c7-41cf-a073-f2c700a699f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6893a9da-4cd2-4976-985f-728ce0f253cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:10 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3af0c56-e148-428e-b734-06e028cc385e]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:10 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Volume volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65 (fbc63a3a-21c5-45e7-8e40-1514e6616a65): created successfully Jun 28 14:34:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6893a9da-4cd2-4976-985f-728ce0f253cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Flow 'volume_create_manager' (007ca116-5c23-46b4-a05b-49d5f9399c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:10 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e109a0d1-55f7-4e08-8b57-9c09f1f081d5 tempest-CreateVolumesFromImageTest-359001968 None] Created volume successfully. Jun 28 14:34:10 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 Jun 28 14:34:10 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:11 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56" returned: 0 in 0.754s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:11 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c 1G Jun 28 14:34:11 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "cinder-fbc63a3a-21c5-45e7-8e40-1514e6616a65-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-fbc63a3a-21c5-45e7-8e40-1514e6616a65-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "cinder-quobyte-fbc63a3a-21c5-45e7-8e40-1514e6616a65" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-quobyte-fbc63a3a-21c5-45e7-8e40-1514e6616a65" acquired by "delete_volume" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:11 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d22c428-5408-4968-93c5-1a273254cd24]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:11 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65 Jun 28 14:34:11 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:12 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c 1G" returned: 0 in 0.771s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:12 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c Jun 28 14:34:12 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:12 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65" returned: 0 in 0.789s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:12 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65 Jun 28 14:34:12 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:12 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c" returned: 0 in 0.682s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:12 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c is being set with open permissions: ugo+rw: NotImplementedError Jun 28 14:34:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:12 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c Jun 28 14:34:12 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:13 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-fbc63a3a-21c5-45e7-8e40-1514e6616a65" returned: 0 in 0.655s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-quobyte-fbc63a3a-21c5-45e7-8e40-1514e6616a65" released by "delete_volume" :: held 1.483s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Created reservations ['cf165849-9733-444c-89c6-a9a423b7cffa', '3975779f-480f-47fd-855a-c01b4905e773', '9f95a3b6-5323-489e-bfea-955ab30d51fe', '7104c02d-cf7d-4f1f-8b9a-9ca21eaa2fb6'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:13 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:34:13 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:13 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c" returned: 0 in 0.668s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:13 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.info Jun 28 14:34:13 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "cinder-7f8da496-c335-4c98-b0f4-57775adccb3b-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-7f8da496-c335-4c98-b0f4-57775adccb3b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "cinder-quobyte-7f8da496-c335-4c98-b0f4-57775adccb3b" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-quobyte-7f8da496-c335-4c98-b0f4-57775adccb3b" acquired by "delete_volume" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ddc59d-dcac-42bf-8ef0-9f72887854b3]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7f8da496-c335-4c98-b0f4-57775adccb3b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:13 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.711s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:34:13 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Deleted volume successfully. Jun 28 14:34:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-54269ac8-c039-4c35-bc63-fd9229937aba tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-fbc63a3a-21c5-45e7-8e40-1514e6616a65-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:13 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7f8da496-c335-4c98-b0f4-57775adccb3b Jun 28 14:34:13 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:14 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.info" returned: 0 in 0.683s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:14 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.info is being set with open permissions: ugo+rw: NotImplementedError Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:14 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.info Jun 28 14:34:14 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:14 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7f8da496-c335-4c98-b0f4-57775adccb3b" returned: 0 in 0.784s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7f8da496-c335-4c98-b0f4-57775adccb3b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:14 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7f8da496-c335-4c98-b0f4-57775adccb3b Jun 28 14:34:14 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:14 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.info" returned: 0 in 0.660s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.314s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.667s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-492579773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaf8a1b-2a6a-4f02-87f2-3cf966521c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e6bc5bbc414165b0f3144f6773980e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:09Z,use_quota=True,user_id='92fa764e8c4a47bcbc59f8bc7025e5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Creating volume acaf8a1b-2a6a-4f02-87f2-3cf966521c2f {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:34:14 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:34:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f 2147483648 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:14 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f 2147483648 Jun 28 14:34:14 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:14 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f1a28486-a5fe-4417-8a7d-09653e633cdf tempest-GroupSnapshotsTest-2037888235 None] group_snapshot f2ed9072-e97d-4a2c-9de2-5bc9570ffce2: created successfully Jun 28 14:34:15 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7f8da496-c335-4c98-b0f4-57775adccb3b" returned: 0 in 0.668s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-quobyte-7f8da496-c335-4c98-b0f4-57775adccb3b" released by "delete_volume" :: held 1.506s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Created reservations ['f8070399-6390-4488-9961-7bf31774c67d', 'bdf72f3a-f19f-4343-99bd-157b67a91ca8', '59fbc575-c54b-48e5-8631-ac606898446b', '0e361cfc-46cc-44e6-a16b-1c47d4c11e94'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:15 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:34:15 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:15 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] group_snapshot f2ed9072-e97d-4a2c-9de2-5bc9570ffce2: deleting Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] group_snapshot f2ed9072-e97d-4a2c-9de2-5bc9570ffce2: deleting {{(pid=93561) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "cinder-quobyte-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "cinder-quobyte-5c007f1e-6924-45c4-a28c-6488a1af975c" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-5c007f1e-6924-45c4-a28c-6488a1af975c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] Deleting offline snapshot 5c007f1e-6924-45c4-a28c-6488a1af975c of volume 2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] snapshot_file for this snap is: volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e42088-6c6e-4930-bf34-189bf6d486b6]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:15 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f 2147483648" returned: 0 in 1.023s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:15 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c Jun 28 14:34:15 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "cinder-ffc98df1-cab7-4c5c-a61b-20757c85c464-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:16 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f Jun 28 14:34:16 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-ffc98df1-cab7-4c5c-a61b-20757c85c464-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "cinder-quobyte-ffc98df1-cab7-4c5c-a61b-20757c85c464" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-quobyte-ffc98df1-cab7-4c5c-a61b-20757c85c464" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18475e4-b241-483c-93a9-5e69790ca566]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ffc98df1-cab7-4c5c-a61b-20757c85c464 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:16 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.752s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:34:16 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Deleted volume successfully. Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e878089d-add1-45e1-928f-66bfe663ff60 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-7f8da496-c335-4c98-b0f4-57775adccb3b-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:16 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ffc98df1-cab7-4c5c-a61b-20757c85c464 Jun 28 14:34:16 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:16 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c" returned: 0 in 0.888s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5595c81-bdd1-4b12-a5cf-6e85c152d5d1]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:16 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f" returned: 0 in 0.788s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7759896-7480-4299-9a32-04d4b0b34d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f', 'volume_size': 2}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2393ef-e165-4c1a-a5fd-386987b4e826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:16 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Volume volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f (acaf8a1b-2a6a-4f02-87f2-3cf966521c2f): created successfully Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2393ef-e165-4c1a-a5fd-386987b4e826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Flow 'volume_create_manager' (1b71f54a-cfd4-4496-9fbf-342c3bfc48cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:16 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a3d520fc-8035-4284-8570-d3ade64a4f18 tempest-VolumesCloneNegativeTest-1781345831 None] Created volume successfully. Jun 28 14:34:16 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 Jun 28 14:34:16 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:16 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ffc98df1-cab7-4c5c-a61b-20757c85c464" returned: 0 in 0.798s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ffc98df1-cab7-4c5c-a61b-20757c85c464 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:16 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ffc98df1-cab7-4c5c-a61b-20757c85c464 Jun 28 14:34:16 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:17 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56" returned: 0 in 0.800s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:17 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c Jun 28 14:34:17 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:17 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ffc98df1-cab7-4c5c-a61b-20757c85c464" returned: 0 in 0.651s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-quobyte-ffc98df1-cab7-4c5c-a61b-20757c85c464" released by "delete_volume" :: held 1.495s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Created reservations ['8c62372c-983d-4164-8a6d-914334c50c57', '26183945-a977-4d65-b628-fdc50efcdbd3', '30347dc5-5640-4eef-9a3e-ce52cba6aff6', '4742b9e6-e0e8-4122-a677-de8799fc0857'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Acquiring lock "cinder-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:17 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:34:17 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Lock "cinder-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Acquiring lock "cinder-quobyte-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Lock "cinder-quobyte-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc07dfc-ec4f-4073-8e9a-dbca1791729b]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:17 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f Jun 28 14:34:17 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "cinder-0df5d18b-caaf-4e4a-b863-6d066bf637ee-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-0df5d18b-caaf-4e4a-b863-6d066bf637ee-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:18 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c" returned: 0 in 0.831s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:18 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c Jun 28 14:34:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "cinder-quobyte-0df5d18b-caaf-4e4a-b863-6d066bf637ee" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:18 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-quobyte-0df5d18b-caaf-4e4a-b863-6d066bf637ee" acquired by "delete_volume" :: waited 0.026s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:18 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f74459-f0c5-46ad-8b40-483e084e51bf]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:18 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.748s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:18 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:34:18 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Deleted volume successfully. Jun 28 14:34:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-80d16505-97ac-4065-9a62-09ad1b1a5744 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-ffc98df1-cab7-4c5c-a61b-20757c85c464-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:18 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee Jun 28 14:34:18 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:18 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f" returned: 0 in 0.887s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:18 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f Jun 28 14:34:18 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:19 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56.5c007f1e-6924-45c4-a28c-6488a1af975c" returned: 0 in 0.775s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-5c007f1e-6924-45c4-a28c-6488a1af975c" released by "_delete_snapshot" :: held 3.402s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56" released by "delete_snapshot" :: held 3.432s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:19 devstack cinder-volume[93561]: WARNING cinder.quota [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-33486222 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-33486222, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:34:19 devstack cinder-volume[93561]: WARNING cinder.quota [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-33486222 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-33486222, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] Created reservations ['9704d7cf-9efa-448b-95c7-b79bfbce08ad', 'ceba298f-6432-4f42-aa24-575119a6e94d', '16a191c1-3313-464d-8d45-2a0883a176cf', '8a38ed2c-286e-4350-a997-2e1842174614'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:19 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee" returned: 0 in 0.826s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:19 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee Jun 28 14:34:19 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:19 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-9ee39b16-61ef-4ddb-a480-8cc1da5ca26a tempest-GroupSnapshotsTest-2037888235 None] group_snapshot f2ed9072-e97d-4a2c-9de2-5bc9570ffce2: deleted successfully Jun 28 14:34:19 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f" returned: 0 in 0.708s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Lock "cinder-quobyte-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f" released by "delete_volume" :: held 1.641s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Created reservations ['c167dd74-5ea2-4333-8eae-cca219ef031a', 'c1e68b33-dfee-4720-aa89-d4cd50137e95', '8646594e-5f56-49a8-8fa7-7f8cae2c979a', 'b5c1e5eb-085e-42db-afd6-97c2b27f6f1d'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:19 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:34:19 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:19 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0df5d18b-caaf-4e4a-b863-6d066bf637ee" returned: 0 in 0.701s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-quobyte-0df5d18b-caaf-4e4a-b863-6d066bf637ee" released by "delete_volume" :: held 1.579s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Created reservations ['f08d9fef-fbf2-4e2f-89cf-d6b9136cf44f', 'cef0f8d9-9275-4351-bca4-3946f2d1b841', '3e8d3e73-ee00-45b5-9b64-8d878696188a', 'af3db38b-13db-427e-8772-87a1ba6c8a13'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:20 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:34:20 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:20 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.719s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:34:20 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Deleted volume successfully. Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-1c59159c-2dc4-419e-8c87-57b7a739b587 tempest-VolumesCloneNegativeTest-1781345831 None] Lock "cinder-acaf8a1b-2a6a-4f02-87f2-3cf966521c2f-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "cinder-quobyte-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56" acquired by "delete_volume" :: waited 0.029s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0f2e7a-9a4f-4cf6-b7f0-6ff707e53459]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "cinder-54023bf5-a127-4942-8187-be904ab89ec3-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-54023bf5-a127-4942-8187-be904ab89ec3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "cinder-quobyte-54023bf5-a127-4942-8187-be904ab89ec3" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-quobyte-54023bf5-a127-4942-8187-be904ab89ec3" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:20 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 Jun 28 14:34:20 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4dfeb3-74b6-4a25-8dc1-d852b0d21b25]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-54023bf5-a127-4942-8187-be904ab89ec3 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:20 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-54023bf5-a127-4942-8187-be904ab89ec3 Jun 28 14:34:20 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:21 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.849s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:21 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:34:21 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Deleted volume successfully. Jun 28 14:34:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e16a47a4-481f-4851-ac70-63cdac1a3286 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-0df5d18b-caaf-4e4a-b863-6d066bf637ee-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:21 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56" returned: 0 in 0.995s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:21 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56 Jun 28 14:34:21 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:21 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-54023bf5-a127-4942-8187-be904ab89ec3" returned: 0 in 0.975s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-54023bf5-a127-4942-8187-be904ab89ec3 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:21 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-54023bf5-a127-4942-8187-be904ab89ec3 Jun 28 14:34:21 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:22 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56" returned: 0 in 0.717s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Lock "cinder-quobyte-2dccaa83-2d9a-436f-88e5-63e3ff7a0a56" released by "delete_volume" :: held 1.792s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Created reservations ['392be6ef-dc94-4f6a-9914-50defd92a6a6'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:22 devstack cinder-volume[93561]: WARNING cinder.quota [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-33486222 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-33486222, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Created reservations ['bc740be8-6aa4-4593-9d80-a1a63bdf347c', 'f6d4bf1d-2de8-4b9c-9225-a644f21b0d9f', '8db33b76-8bfd-4be7-a302-f902ccaaf800', '9f20e5ab-a7c3-4453-9d62-7fb6c54b1349'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:22 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-54023bf5-a127-4942-8187-be904ab89ec3" returned: 0 in 0.723s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-quobyte-54023bf5-a127-4942-8187-be904ab89ec3" released by "delete_volume" :: held 1.750s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Created reservations ['22404483-9c17-44ed-a977-3e98d4c3f8bf', 'd4390cda-bb54-4593-b29a-2ff0cddddc03', '0fa8483b-c956-4ef6-993c-100d6215f071', '960142d4-1bd1-4efe-b9ac-eaea0af94406'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:22 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:34:22 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:22 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:34:22 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:23 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.800s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:23 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:34:23 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c2d9ecf0-f460-4f7f-9d40-60637b99b9e7 tempest-GroupSnapshotsTest-2037888235 None] Delete group completed successfully. Jun 28 14:34:23 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.925s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:23 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:34:23 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Deleted volume successfully. Jun 28 14:34:23 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fef12ed3-4fed-4084-aa03-da1fcbf037c3 tempest-CreateVolumesFromImageTest-359001968 None] Lock "cinder-54023bf5-a127-4942-8187-be904ab89ec3-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:23 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:34:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Flow 'volume_create_manager' (36672e2a-bb2f-4397-b263-ec3469a3ccd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd1c69a-24a1-419e-8f70-477e3f7728ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd1c69a-24a1-419e-8f70-477e3f7728ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1658053356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f776cc-b8fb-4304-91d2-be72129b5450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63598fb798154db78337a11ebc8238e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:24Z,use_quota=True,user_id='b3cadbb7bd6c431c9063a9ba3882f070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30690b5-a3a3-4525-9029-37e8b29ab63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30690b5-a3a3-4525-9029-37e8b29ab63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64fe2520-9ab1-4105-9e89-074dbb120b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:23 devstack cinder-volume[93561]: DEBUG cinder.image.glance [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Creating Keystone auth plugin from conf {{(pid=93561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 28 14:34:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64fe2520-9ab1-4105-9e89-074dbb120b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b4f776cc-b8fb-4304-91d2-be72129b5450', 'volume_name': 'volume-b4f776cc-b8fb-4304-91d2-be72129b5450', 'volume_size': 1, 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e2aafa849d4b7590b8e84dddedb04b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'created_at': datetime.datetime(2026, 6, 28, 12, 14, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 14, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5ecd6c-285f-4d5a-afff-1183533c0eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5ecd6c-285f-4d5a-afff-1183533c0eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00e7ba0-b3a7-49d4-99bb-2e196119e1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:24 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Volume b4f776cc-b8fb-4304-91d2-be72129b5450: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b4f776cc-b8fb-4304-91d2-be72129b5450', 'volume_size': 1, 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e2aafa849d4b7590b8e84dddedb04b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'created_at': datetime.datetime(2026, 6, 28, 12, 14, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 14, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 28 14:34:24 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Trying to clone b4f776cc-b8fb-4304-91d2-be72129b5450 from image dfdfa247-b97d-4fd5-928f-a01fae72e0ac at location (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]). {{(pid=93561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 28 14:34:24 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pkp5rn67devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 28 14:34:24 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Image download 20.69 MB at 20.69 MB/s Jun 28 14:34:24 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1582cb-67b0-4bd2-add1-18a02216d932]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pkp5rn67devstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:24 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pkp5rn67devstack@QuobyteHD Jun 28 14:34:24 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:25 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pkp5rn67devstack@QuobyteHD" returned: 0 in 0.799s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:25 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Temporary image dfdfa247-b97d-4fd5-928f-a01fae72e0ac is fetched for user b3cadbb7bd6c431c9063a9ba3882f070. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 28 14:34:25 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b70f60-d45c-43e7-a72f-18994507a9a6]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pkp5rn67devstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:25 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pkp5rn67devstack@QuobyteHD Jun 28 14:34:25 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:26 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pkp5rn67devstack@QuobyteHD" returned: 0 in 0.823s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1658053356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f776cc-b8fb-4304-91d2-be72129b5450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63598fb798154db78337a11ebc8238e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:24Z,use_quota=True,user_id='b3cadbb7bd6c431c9063a9ba3882f070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Creating volume b4f776cc-b8fb-4304-91d2-be72129b5450 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:34:26 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:34:26 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 1073741824 Jun 28 14:34:26 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Flow 'volume_create_manager' (b1a9a8a7-187c-4041-800a-7783283c1c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b177c5-c51b-479a-873d-2ac3d2fe3342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b177c5-c51b-479a-873d-2ac3d2fe3342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1502674491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65dec24a-0336-4528-a8dd-47830e5b81da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62493fcc595e4f6097f1be0cac0c06ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:26Z,use_quota=True,user_id='0c9b2dd5dfcc451fbd89163ebe3bc54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3c9d57-cf14-4b75-b9d7-4744fd40114d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3c9d57-cf14-4b75-b9d7-4744fd40114d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09debe81-6a2f-44fd-97f3-f6886f4e53d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09debe81-6a2f-44fd-97f3-f6886f4e53d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65dec24a-0336-4528-a8dd-47830e5b81da', 'volume_name': 'volume-65dec24a-0336-4528-a8dd-47830e5b81da', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40c9e7d-680b-4aaa-aedf-1591e3e92f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40c9e7d-680b-4aaa-aedf-1591e3e92f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e77fa6-1e4f-4b21-aaaf-f5affb2b81e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:26 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Volume 65dec24a-0336-4528-a8dd-47830e5b81da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65dec24a-0336-4528-a8dd-47830e5b81da', 'volume_size': 1} Jun 28 14:34:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:27 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 1073741824" returned: 0 in 0.844s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:27 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 Jun 28 14:34:27 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:28 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450" returned: 0 in 0.652s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.444s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1502674491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65dec24a-0336-4528-a8dd-47830e5b81da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62493fcc595e4f6097f1be0cac0c06ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:26Z,use_quota=True,user_id='0c9b2dd5dfcc451fbd89163ebe3bc54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Creating volume 65dec24a-0336-4528-a8dd-47830e5b81da {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:34:28 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:28 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da 1073741824 Jun 28 14:34:28 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Attempting download of dfdfa247-b97d-4fd5-928f-a01fae72e0ac ((None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}])) to volume b4f776cc-b8fb-4304-91d2-be72129b5450. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b994fc-8316-46f6-a5db-1acb08bff3a2]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pcdyxzup {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:28 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pcdyxzup Jun 28 14:34:28 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:28 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-4216eac3-85f5-4ccc-b9ec-7287617b5a07 tempest-GroupSnapshotsV319Test-1739160560 None] Group tempest-GroupSnapshotsV319Test-Group-1393167877: creating Jun 28 14:34:28 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-4216eac3-85f5-4ccc-b9ec-7287617b5a07 tempest-GroupSnapshotsV319Test-1739160560 None] Group tempest-GroupSnapshotsV319Test-Group-1393167877: created successfully Jun 28 14:34:28 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-4216eac3-85f5-4ccc-b9ec-7287617b5a07 tempest-GroupSnapshotsV319Test-1739160560 None] Create group completed successfully. Jun 28 14:34:28 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pcdyxzup" returned: 0 in 0.767s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pcdyxzup {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:28 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da 1073741824" returned: 0 in 0.904s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:29 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da Jun 28 14:34:29 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:29 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pcdyxzup Jun 28 14:34:29 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:29 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da" returned: 0 in 0.634s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:34:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:29 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e77fa6-1e4f-4b21-aaaf-f5affb2b81e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65dec24a-0336-4528-a8dd-47830e5b81da', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c687ba6-9ec5-44ee-9dde-9656bf0e3013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pcdyxzup" returned: 1 in 0.743s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pcdyxzup' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:34:29 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da061b7-f6f3-4d48-a72d-3a734a7b4594]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pkp5rn67devstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:29 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Volume volume-65dec24a-0336-4528-a8dd-47830e5b81da (65dec24a-0336-4528-a8dd-47830e5b81da): created successfully Jun 28 14:34:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c687ba6-9ec5-44ee-9dde-9656bf0e3013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Flow 'volume_create_manager' (b1a9a8a7-187c-4041-800a-7783283c1c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:29 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-5f3b1eb8-f4a1-4c33-be6f-6194cdc1d62a tempest-VolumeDependencyTests-647657300 None] Created volume successfully. Jun 28 14:34:29 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pkp5rn67devstack@QuobyteHD Jun 28 14:34:29 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:30 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pkp5rn67devstack@QuobyteHD" returned: 0 in 0.746s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] dfdfa247-b97d-4fd5-928f-a01fae72e0ac was qcow2, converting to raw {{(pid=93561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pkp5rn67devstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:30 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pkp5rn67devstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 Jun 28 14:34:30 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Flow 'volume_create_manager' (7ac2cca1-7330-4cc5-bc53-353df6dc179d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ddbf91-f6db-4b51-9c99-1b59a6e1cbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ddbf91-f6db-4b51-9c99-1b59a6e1cbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1496290631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43141549-a9c7-42b2-871d-87d09e87e12e,host='devstack@QuobyteHD#QuobyteHD',id=c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eca56976d2547328955b72e916231d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:30Z,use_quota=True,user_id='c11bb44024404526a1a99b32be73e918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ea7747e-a077-4827-a5b0-fd815c16f9f8),volume_type_id=0ea7747e-a077-4827-a5b0-fd815c16f9f8)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20910c5-1ba7-4f50-9b0c-453227041c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20910c5-1ba7-4f50-9b0c-453227041c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b254cbf-a4c7-4994-8caa-aa51fec0eaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b254cbf-a4c7-4994-8caa-aa51fec0eaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7', 'volume_name': 'volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5241e5-fa4e-4755-b1c2-7071c73023d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5241e5-fa4e-4755-b1c2-7071c73023d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49da4679-a504-4a4c-a23e-248251454488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:30 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Volume c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7', 'volume_size': 1} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=43141549-a9c7-42b2-871d-87d09e87e12e,created_at=2026-06-28T12:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1496290631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43141549-a9c7-42b2-871d-87d09e87e12e,host='devstack@QuobyteHD#QuobyteHD',id=c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eca56976d2547328955b72e916231d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:30Z,use_quota=True,user_id='c11bb44024404526a1a99b32be73e918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ea7747e-a077-4827-a5b0-fd815c16f9f8),volume_type_id=0ea7747e-a077-4827-a5b0-fd815c16f9f8)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Creating volume c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:34:30 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:30 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 1073741824 Jun 28 14:34:30 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:31 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 1073741824" returned: 0 in 0.960s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:31 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 Jun 28 14:34:31 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:32 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7" returned: 0 in 0.735s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:34:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:32 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.537s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pkp5rn67devstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450" returned: 0 in 1.944s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:32 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_pkp5rn67devstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:34:32 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Converted 112.00 MB image at 57.55 MB/s Jun 28 14:34:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] Creating offline snapshot b038dee5-2e5a-46ec-ba20-8104442ecb7e of volume 65dec24a-0336-4528-a8dd-47830e5b81da {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:34:32 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 1G Jun 28 14:34:32 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49da4679-a504-4a4c-a23e-248251454488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074419af-8768-45e7-98c3-d1faf9e70cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:32 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[68821f11-a1bb-45be-9782-cd041bbc3876]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:32 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Volume volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 (c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7): created successfully Jun 28 14:34:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074419af-8768-45e7-98c3-d1faf9e70cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Flow 'volume_create_manager' (7ac2cca1-7330-4cc5-bc53-353df6dc179d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:32 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-37dc058f-9143-43b2-a8fb-0a3b86219ba3 tempest-GroupSnapshotsV319Test-1739160560 None] Created volume successfully. Jun 28 14:34:32 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da Jun 28 14:34:32 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:33 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 1G" returned: 0 in 0.699s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:33 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[791d81a7-3aae-461c-b552-01cad0148f94]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:33 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] GroupSnapshot 05056b94-767e-4648-83cf-54ce2e275fef: creating. Jun 28 14:34:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] Group snapshot 05056b94-767e-4648-83cf-54ce2e275fef: creating. {{(pid=93561) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 28 14:34:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:33 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 Jun 28 14:34:33 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:33 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da" returned: 0 in 0.834s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:33 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e 1G Jun 28 14:34:33 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:33 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450" returned: 0 in 0.773s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:33 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 Jun 28 14:34:34 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:34 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e 1G" returned: 0 in 0.808s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dec24a-0336-4528-a8dd-47830e5b81da -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:34 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dec24a-0336-4528-a8dd-47830e5b81da -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e Jun 28 14:34:34 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:34 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450" returned: 1 in 0.756s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:34:34 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Downloaded image dfdfa247-b97d-4fd5-928f-a01fae72e0ac ((None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}])) to volume b4f776cc-b8fb-4304-91d2-be72129b5450 successfully. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 28 14:34:34 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Temporary image dfdfa247-b97d-4fd5-928f-a01fae72e0ac for user b3cadbb7bd6c431c9063a9ba3882f070 is deleted. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 28 14:34:34 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Marking volume b4f776cc-b8fb-4304-91d2-be72129b5450 as bootable. {{(pid=93561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 28 14:34:34 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Copying metadata from image dfdfa247-b97d-4fd5-928f-a01fae72e0ac to b4f776cc-b8fb-4304-91d2-be72129b5450. {{(pid=93561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 28 14:34:34 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Creating volume glance metadata for volume b4f776cc-b8fb-4304-91d2-be72129b5450 backed by image dfdfa247-b97d-4fd5-928f-a01fae72e0ac with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 28 14:34:34 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dec24a-0336-4528-a8dd-47830e5b81da -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e" returned: 0 in 0.686s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:34 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e is being set with open permissions: ugo+rw Jun 28 14:34:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00e7ba0-b3a7-49d4-99bb-2e196119e1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4f776cc-b8fb-4304-91d2-be72129b5450', 'volume_size': 1, 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e2aafa849d4b7590b8e84dddedb04b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'created_at': datetime.datetime(2026, 6, 28, 12, 14, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 14, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:34 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e Jun 28 14:34:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055cc60c-4752-461b-ad4f-b7d88a4bd139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:34 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:34 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Volume volume-b4f776cc-b8fb-4304-91d2-be72129b5450 (b4f776cc-b8fb-4304-91d2-be72129b5450): created successfully Jun 28 14:34:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055cc60c-4752-461b-ad4f-b7d88a4bd139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Flow 'volume_create_manager' (36672e2a-bb2f-4397-b263-ec3469a3ccd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:34 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-96b204b2-2990-4e00-a921-12dec1f1214f tempest-VolumesExtendTest-1446854052 None] Created volume successfully. Jun 28 14:34:35 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e" returned: 0 in 0.659s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:35 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.info Jun 28 14:34:35 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-89089f99-f822-49ab-a821-a2cb8c7f2fb7 tempest-VolumesExtendTest-1446854052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:36 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.info" returned: 0 in 0.655s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:36 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.info is being set with open permissions: ugo+rw Jun 28 14:34:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:36 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.info Jun 28 14:34:36 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:36 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.info" returned: 0 in 0.639s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.388s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.543s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] Creating offline snapshot 5baf4910-b69a-4b5e-9fac-ea52bdf5adef of volume c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:34:36 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ec18c3fb-e1ce-4b7e-8069-1d236b891e40 tempest-VolumeDependencyTests-647657300 None] Create snapshot completed successfully Jun 28 14:34:36 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b080fd-ac92-4b02-bc1a-172a2054ac33]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:36 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 Jun 28 14:34:36 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:37 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7" returned: 0 in 0.800s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:37 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef 1G Jun 28 14:34:37 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Flow 'volume_create_manager' (0d59d145-2d0d-4bda-befe-d5b062b4ecc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e65a55-7299-430a-a5b9-15e6777be66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e65a55-7299-430a-a5b9-15e6777be66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1072973677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd84927-130e-49f9-ad23-87374390d2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62493fcc595e4f6097f1be0cac0c06ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b038dee5-2e5a-46ec-ba20-8104442ecb7e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:38Z,use_quota=True,user_id='0c9b2dd5dfcc451fbd89163ebe3bc54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95db5211-caa8-4c4f-a7ea-8f56aac3497b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95db5211-caa8-4c4f-a7ea-8f56aac3497b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18620baf-b17b-4d75-9c00-e6f9abf7d658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18620baf-b17b-4d75-9c00-e6f9abf7d658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5cd84927-130e-49f9-ad23-87374390d2c6', 'volume_name': 'volume-5cd84927-130e-49f9-ad23-87374390d2c6', 'volume_size': 1, 'snapshot_id': 'b038dee5-2e5a-46ec-ba20-8104442ecb7e'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6bf583d-ecc9-441d-a384-9216fdc74941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6bf583d-ecc9-441d-a384-9216fdc74941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77a46d6-ecc9-475b-a924-e7cbead7aee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:37 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Volume 5cd84927-130e-49f9-ad23-87374390d2c6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5cd84927-130e-49f9-ad23-87374390d2c6', 'volume_size': 1, 'snapshot_id': 'b038dee5-2e5a-46ec-ba20-8104442ecb7e'} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:37 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:34:37 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:38 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef 1G" returned: 0 in 0.799s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:38 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef Jun 28 14:34:38 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:38 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.654s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:34:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:34:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 28 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:34:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:34:39 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef" returned: 0 in 0.696s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:39 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef is being set with open permissions: ugo+rw: NotImplementedError Jun 28 14:34:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:39 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef Jun 28 14:34:39 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:39 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef" returned: 0 in 0.620s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:39 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.info Jun 28 14:34:39 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:40 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.info" returned: 0 in 0.644s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:40 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.info is being set with open permissions: ugo+rw: NotImplementedError Jun 28 14:34:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:40 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.info Jun 28 14:34:40 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:41 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.info" returned: 0 in 0.639s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.281s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-89089f99-f822-49ab-a821-a2cb8c7f2fb7 tempest-VolumesExtendTest-1446854052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 5.482s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:41 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9334c7-ad95-4c9c-89a6-41f81348f25e]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-89089f99-f822-49ab-a821-a2cb8c7f2fb7 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:41 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-315a9e72-0df0-499d-bd3a-d65062371272 tempest-GroupSnapshotsV319Test-1739160560 None] group_snapshot 05056b94-767e-4648-83cf-54ce2e275fef: created successfully Jun 28 14:34:41 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 Jun 28 14:34:41 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:41 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-89089f99-f822-49ab-a821-a2cb8c7f2fb7 tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450" returned: 0 in 0.772s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-89089f99-f822-49ab-a821-a2cb8c7f2fb7 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:41 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] group_snapshot 05056b94-767e-4648-83cf-54ce2e275fef: deleting Jun 28 14:34:41 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 Jun 28 14:34:41 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:41 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] group_snapshot 05056b94-767e-4648-83cf-54ce2e275fef: deleting {{(pid=93561) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 28 14:34:41 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] Acquiring lock "cinder-quobyte-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] Lock "cinder-quobyte-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] Acquiring lock "cinder-quobyte-5baf4910-b69a-4b5e-9fac-ea52bdf5adef" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] Lock "cinder-quobyte-5baf4910-b69a-4b5e-9fac-ea52bdf5adef" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] Deleting offline snapshot 5baf4910-b69a-4b5e-9fac-ea52bdf5adef of volume c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] snapshot_file for this snap is: volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b087f1-400f-47c5-a35e-05e502d6cfe3]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:42 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef Jun 28 14:34:42 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:42 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-89089f99-f822-49ab-a821-a2cb8c7f2fb7 tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450" returned: 1 in 0.782s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-89089f99-f822-49ab-a821-a2cb8c7f2fb7 tempest-VolumesExtendTest-1446854052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-89089f99-f822-49ab-a821-a2cb8c7f2fb7 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 2G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-89089f99-f822-49ab-a821-a2cb8c7f2fb7 tempest-VolumesExtendTest-1446854052 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 2G" returned: 0 in 0.056s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-89089f99-f822-49ab-a821-a2cb8c7f2fb7 tempest-VolumesExtendTest-1446854052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.650s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.986s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Acquiring lock "cinder-quobyte-b038dee5-2e5a-46ec-ba20-8104442ecb7e-5cd84927-130e-49f9-ad23-87374390d2c6" by "_create_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Lock "cinder-quobyte-b038dee5-2e5a-46ec-ba20-8104442ecb7e-5cd84927-130e-49f9-ad23-87374390d2c6" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Creating volume 5cd84927-130e-49f9-ad23-87374390d2c6 from snapshot b038dee5-2e5a-46ec-ba20-8104442ecb7e {{(pid=93561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Acquiring lock "cinder-quobyte-5cd84927-130e-49f9-ad23-87374390d2c6" by "_copy_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Lock "cinder-quobyte-5cd84927-130e-49f9-ad23-87374390d2c6" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] snapshot: b038dee5-2e5a-46ec-ba20-8104442ecb7e, volume: 5cd84927-130e-49f9-ad23-87374390d2c6, {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:42 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-89089f99-f822-49ab-a821-a2cb8c7f2fb7 tempest-VolumesExtendTest-1446854052 None] Extend volume completed successfully. Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[90770930-308c-4510-baad-0ed0ca4667e4]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:42 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef" returned: 0 in 0.817s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d2f01f-d10a-4c80-994b-53e721bb7e29]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:42 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e Jun 28 14:34:42 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:43 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 Jun 28 14:34:43 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Acquiring lock "cinder-b4f776cc-b8fb-4304-91d2-be72129b5450-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Lock "cinder-b4f776cc-b8fb-4304-91d2-be72129b5450-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Acquiring lock "cinder-quobyte-b4f776cc-b8fb-4304-91d2-be72129b5450" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Lock "cinder-quobyte-b4f776cc-b8fb-4304-91d2-be72129b5450" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:43 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1f3c08-268a-48bb-93ee-aa5eb1638e5f]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:43 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 Jun 28 14:34:43 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:43 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e" returned: 0 in 0.860s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65dec24a-0336-4528-a8dd-47830e5b81da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:34:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 28 14:34:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Creating direct copy from snapshot {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 28 14:34:43 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[501abcf8-f829-40cb-8c3a-70bef4601c0d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:43 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7" returned: 0 in 0.816s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:43 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef Jun 28 14:34:43 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:43 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da Jun 28 14:34:43 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:44 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450" returned: 0 in 0.815s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:44 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 Jun 28 14:34:44 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:44 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da" returned: 0 in 0.814s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:44 devstack cinder-volume[93561]: DEBUG cinder.utils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Path /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5cd84927-130e-49f9-ad23-87374390d2c6 not found in is_blk_device check {{(pid=93561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 28 14:34:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5cd84927-130e-49f9-ad23-87374390d2c6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:44 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef" returned: 0 in 0.793s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:44 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5cd84927-130e-49f9-ad23-87374390d2c6 Jun 28 14:34:44 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:44 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef Jun 28 14:34:44 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:45 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450" returned: 1 in 0.819s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:34:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:45 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450 Jun 28 14:34:45 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:45 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7.5baf4910-b69a-4b5e-9fac-ea52bdf5adef" returned: 0 in 0.648s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:45 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] Lock "cinder-quobyte-5baf4910-b69a-4b5e-9fac-ea52bdf5adef" released by "_delete_snapshot" :: held 3.180s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:45 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] Lock "cinder-quobyte-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7" released by "delete_snapshot" :: held 3.203s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:45 devstack cinder-volume[93561]: WARNING cinder.quota [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-783640380 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-783640380, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:34:45 devstack cinder-volume[93561]: WARNING cinder.quota [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-783640380 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-783640380, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:34:45 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] Created reservations ['2c0c7575-c5b9-42b7-846e-eb6bf839adc6', 'ed75df01-6a91-482a-acb2-e8775ed66ee3', 'c29f4eb1-6bab-46f5-89cc-0eccc0558fd1', 'c08f0cb9-8ce3-4a97-a0a3-5d5080d52789'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:45 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-533565c4-0e6d-4ee5-9009-8a79a4534d96 tempest-GroupSnapshotsV319Test-1739160560 None] group_snapshot 05056b94-767e-4648-83cf-54ce2e275fef: deleted successfully Jun 28 14:34:45 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4f776cc-b8fb-4304-91d2-be72129b5450" returned: 0 in 0.938s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:45 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Lock "cinder-quobyte-b4f776cc-b8fb-4304-91d2-be72129b5450" released by "delete_volume" :: held 2.649s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:46 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Created reservations ['b031c434-3aeb-4c6d-b2b2-40d858554041', '1ab5f339-f830-495c-a016-4ab9172e17c1', '424c6614-f262-4fe9-8a72-b9b750fdac65', '8ddf6c7b-3532-4424-84fa-7890863a2f50'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:46 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:34:46 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Acquiring lock "cinder-quobyte-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Lock "cinder-quobyte-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7" acquired by "delete_volume" :: waited 0.075s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:47 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d99093-c8fb-4eb7-aee3-35b9baffb3fa]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:47 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 Jun 28 14:34:47 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:48 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:34:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Flow 'volume_create_manager' (1751ebd0-35db-46e5-a028-c99043b245b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445abb01-e81d-418b-bf88-ef0751f9474b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445abb01-e81d-418b-bf88-ef0751f9474b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1842389510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b547c79-2e3a-4162-94e1-6b2bcde1b9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63598fb798154db78337a11ebc8238e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:48Z,use_quota=True,user_id='b3cadbb7bd6c431c9063a9ba3882f070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68ea84a-9a92-42e2-8de7-b3f55e8baa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68ea84a-9a92-42e2-8de7-b3f55e8baa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee9c1dc-31b4-4654-8018-73e838135dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee9c1dc-31b4-4654-8018-73e838135dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b547c79-2e3a-4162-94e1-6b2bcde1b9a1', 'volume_name': 'volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbbeb5c8-fc97-4aa7-8db5-e70ebb7c24d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbbeb5c8-fc97-4aa7-8db5-e70ebb7c24d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:48 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc9c9c5-3acf-4724-bdab-4949035ad3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:48 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Volume 5b547c79-2e3a-4162-94e1-6b2bcde1b9a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1', 'volume_size': 1} Jun 28 14:34:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:48 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 2.236s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:48 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:34:48 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Deleted volume successfully. Jun 28 14:34:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-140fec10-2ec4-42f6-955c-25d200b06c71 tempest-VolumesExtendTest-1446854052 None] Lock "cinder-b4f776cc-b8fb-4304-91d2-be72129b5450-delete_volume" released by "delete_volume" :: held 5.346s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:49 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7" returned: 0 in 2.138s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:49 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7 Jun 28 14:34:49 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:50 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5cd84927-130e-49f9-ad23-87374390d2c6" returned: 0 in 5.675s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:50 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e96c230-6163-4f09-934c-8abb7050b22f]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:50 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da Jun 28 14:34:50 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:50 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7" returned: 0 in 0.929s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Lock "cinder-quobyte-c8a53ffe-a2c1-46bc-acd9-95e7a226cfe7" released by "delete_volume" :: held 3.223s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:50 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Created reservations ['378ee7c2-dd3e-4792-a6af-7632b783c548'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:50 devstack cinder-volume[93561]: WARNING cinder.quota [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-783640380 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-783640380, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:34:50 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Created reservations ['6a75288b-639c-43fb-a961-1cdacf5cb2a0', '642aab6e-3054-4c49-9a25-ee28e3ff03a7', '1647d5c0-ed0c-437a-8c8e-973a7d124305', '91472b3b-8b49-4d6c-b4d0-87fbfe1b01d3'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:50 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:34:50 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:51 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da" returned: 0 in 0.965s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Image conversion details: src /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5cd84927-130e-49f9-ad23-87374390d2c6 {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:34:51 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Converted 1024.00 MB image at 180.39 MB/s Jun 28 14:34:51 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5cd84927-130e-49f9-ad23-87374390d2c6 is being set with open permissions: ugo+rw Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5cd84927-130e-49f9-ad23-87374390d2c6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:51 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5cd84927-130e-49f9-ad23-87374390d2c6 Jun 28 14:34:51 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:51 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.679s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:34:51 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-dfc55822-716c-44a3-9104-2557efbd2162 tempest-GroupSnapshotsV319Test-1739160560 None] Delete group completed successfully. Jun 28 14:34:51 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5cd84927-130e-49f9-ad23-87374390d2c6" returned: 0 in 0.672s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Lock "cinder-quobyte-5cd84927-130e-49f9-ad23-87374390d2c6" released by "_copy_volume_from_snapshot" :: held 9.102s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Lock "cinder-quobyte-b038dee5-2e5a-46ec-ba20-8104442ecb7e-5cd84927-130e-49f9-ad23-87374390d2c6" released by "_create_volume_from_snapshot" :: held 9.138s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.157s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.390s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1842389510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b547c79-2e3a-4162-94e1-6b2bcde1b9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63598fb798154db78337a11ebc8238e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:34:48Z,use_quota=True,user_id='b3cadbb7bd6c431c9063a9ba3882f070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Creating volume 5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:34:51 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:51 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 1073741824 Jun 28 14:34:51 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77a46d6-ecc9-475b-a924-e7cbead7aee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd84927-130e-49f9-ad23-87374390d2c6', 'volume_size': 1, 'snapshot_id': 'b038dee5-2e5a-46ec-ba20-8104442ecb7e'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833bbe86-0c2d-4770-a365-c4d2db212c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:51 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Volume volume-5cd84927-130e-49f9-ad23-87374390d2c6 (5cd84927-130e-49f9-ad23-87374390d2c6): created successfully Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833bbe86-0c2d-4770-a365-c4d2db212c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Flow 'volume_create_manager' (0d59d145-2d0d-4bda-befe-d5b062b4ecc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:51 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-42e94d82-5524-46f7-b85c-f7b8e1acfff4 tempest-VolumeDependencyTests-647657300 None] Created volume successfully. Jun 28 14:34:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Acquiring lock "cinder-b038dee5-2e5a-46ec-ba20-8104442ecb7e-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Lock "cinder-b038dee5-2e5a-46ec-ba20-8104442ecb7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Acquiring lock "cinder-quobyte-65dec24a-0336-4528-a8dd-47830e5b81da" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Lock "cinder-quobyte-65dec24a-0336-4528-a8dd-47830e5b81da" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Acquiring lock "cinder-quobyte-b038dee5-2e5a-46ec-ba20-8104442ecb7e" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Lock "cinder-quobyte-b038dee5-2e5a-46ec-ba20-8104442ecb7e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Deleting offline snapshot b038dee5-2e5a-46ec-ba20-8104442ecb7e of volume 65dec24a-0336-4528-a8dd-47830e5b81da {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:34:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] snapshot_file for this snap is: volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:34:52 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e9fa2e-8317-428d-9e2e-ed1b198fee92]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:52 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e Jun 28 14:34:52 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:52 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 1073741824" returned: 0 in 0.926s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:52 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 Jun 28 14:34:52 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:53 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e" returned: 0 in 0.868s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:53 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65dec24a-0336-4528-a8dd-47830e5b81da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:34:53 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc0ed75-2293-4362-9990-7982b69b191d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:53 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da Jun 28 14:34:53 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:53 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1" returned: 0 in 0.750s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:53 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:34:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:53 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc9c9c5-3acf-4724-bdab-4949035ad3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:53 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8612465-04a2-405b-903d-fbe0ffec64d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:34:53 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Volume volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 (5b547c79-2e3a-4162-94e1-6b2bcde1b9a1): created successfully Jun 28 14:34:53 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8612465-04a2-405b-903d-fbe0ffec64d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:34:53 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Flow 'volume_create_manager' (1751ebd0-35db-46e5-a028-c99043b245b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:34:53 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-0f59b53a-fb89-4f3e-9c59-d5960c0c1d79 tempest-VolumesExtendTest-1446854052 None] Created volume successfully. Jun 28 14:34:54 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da" returned: 0 in 0.864s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:54 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e Jun 28 14:34:54 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:54 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] Creating offline snapshot 73426331-3016-40ee-a0af-1c96a57bf6c4 of volume 5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:34:54 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6264b59c-4d1b-49af-a40a-8dfba9d80a88]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:54 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 Jun 28 14:34:54 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:54 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e" returned: 0 in 0.822s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:55 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e Jun 28 14:34:55 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:55 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1" returned: 0 in 0.825s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:55 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da.b038dee5-2e5a-46ec-ba20-8104442ecb7e" returned: 0 in 0.681s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:55 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 1G Jun 28 14:34:55 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Lock "cinder-quobyte-b038dee5-2e5a-46ec-ba20-8104442ecb7e" released by "_delete_snapshot" :: held 3.369s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Lock "cinder-quobyte-65dec24a-0336-4528-a8dd-47830e5b81da" released by "delete_snapshot" :: held 3.399s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:55 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Created reservations ['f8eacc2b-ed16-46c3-9a26-9586d9bb6d29', '376548d0-122c-4325-9606-478a547cb765', 'df798ed7-adc5-4149-9931-064c14ace54f', 'b1ac514e-75b7-40e9-952d-d2340cf63196'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:55 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Delete snapshot completed successfully. Jun 28 14:34:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-459fe555-bc17-4de0-8f83-0b6cb3859d4b tempest-VolumeDependencyTests-647657300 None] Lock "cinder-b038dee5-2e5a-46ec-ba20-8104442ecb7e-delete_snapshot" released by "delete_snapshot" :: held 3.586s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:56 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 1G" returned: 0 in 0.838s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:56 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 Jun 28 14:34:56 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Acquiring lock "cinder-65dec24a-0336-4528-a8dd-47830e5b81da-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Lock "cinder-65dec24a-0336-4528-a8dd-47830e5b81da-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Acquiring lock "cinder-quobyte-65dec24a-0336-4528-a8dd-47830e5b81da" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Lock "cinder-quobyte-65dec24a-0336-4528-a8dd-47830e5b81da" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:56 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abe90ef-e869-4804-8a6b-160227a86664]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:56 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da Jun 28 14:34:56 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:57 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4" returned: 0 in 0.751s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:57 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 is being set with open permissions: ugo+rw Jun 28 14:34:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:57 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 Jun 28 14:34:57 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:57 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da" returned: 0 in 0.805s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:57 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da Jun 28 14:34:57 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:57 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4" returned: 0 in 0.728s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:58 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.info Jun 28 14:34:58 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:58 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65dec24a-0336-4528-a8dd-47830e5b81da" returned: 0 in 0.726s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:58 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Lock "cinder-quobyte-65dec24a-0336-4528-a8dd-47830e5b81da" released by "delete_volume" :: held 1.597s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:58 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Created reservations ['403bda08-d666-492a-805b-ef7723b8aa10', '867dc20f-da36-4e55-bbe1-16074a36defe', '4cb54d33-e5f5-419b-a25c-a54e6a7631f3', 'd2381404-5861-421b-a6a7-c2fac18b890f'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:34:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:34:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:34:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:34:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:34:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:58 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:34:58 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:58 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.info" returned: 0 in 0.789s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:58 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.info is being set with open permissions: ugo+rw Jun 28 14:34:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:58 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.info Jun 28 14:34:58 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:58 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Acquiring lock "cinder-5cd84927-130e-49f9-ad23-87374390d2c6-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:58 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Lock "cinder-5cd84927-130e-49f9-ad23-87374390d2c6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:58 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Acquiring lock "cinder-quobyte-5cd84927-130e-49f9-ad23-87374390d2c6" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:34:59 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Lock "cinder-quobyte-5cd84927-130e-49f9-ad23-87374390d2c6" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:34:59 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d596a255-b68d-4a54-ae48-43b9b287cd4d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:34:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5cd84927-130e-49f9-ad23-87374390d2c6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:59 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5cd84927-130e-49f9-ad23-87374390d2c6 Jun 28 14:34:59 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:34:59 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.848s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:59 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:34:59 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Deleted volume successfully. Jun 28 14:34:59 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5134de56-5c7a-47da-b69a-51b49523d08a tempest-VolumeDependencyTests-647657300 None] Lock "cinder-65dec24a-0336-4528-a8dd-47830e5b81da-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:34:59 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.info" returned: 0 in 0.861s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.903s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:34:59 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-b197f750-4f4f-4dd1-8b7e-5d7a955dfd55 tempest-VolumesExtendTest-1446854052 None] Create snapshot completed successfully Jun 28 14:34:59 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Jun 28 14:34:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5cd84927-130e-49f9-ad23-87374390d2c6" returned: 0 in 0.859s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:34:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5cd84927-130e-49f9-ad23-87374390d2c6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:34:59 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5cd84927-130e-49f9-ad23-87374390d2c6 Jun 28 14:34:59 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-989278e0-2736-446c-961c-d5f8e61cca50 tempest-VolumesExtendTest-1446854052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-989278e0-2736-446c-961c-d5f8e61cca50 tempest-VolumesExtendTest-1446854052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:00 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea62163-4f28-425f-8d11-998951827064]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-989278e0-2736-446c-961c-d5f8e61cca50 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:00 devstack sudo[108752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 Jun 28 14:35:00 devstack sudo[108752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:00 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5cd84927-130e-49f9-ad23-87374390d2c6" returned: 0 in 0.760s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:00 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Lock "cinder-quobyte-5cd84927-130e-49f9-ad23-87374390d2c6" released by "delete_volume" :: held 1.669s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:00 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Created reservations ['ee30a346-1a44-4eb5-ac19-7ab05ed471b7', '2718cc0e-f94e-41ef-91ef-f96922ed3bff', '1fb48a8f-e494-4f54-9fca-bc53749a4694', 'fcf75bc8-df96-4f60-a3e8-5a802d4ac6a4'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:35:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:00 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:35:00 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:01 devstack sudo[108752]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-989278e0-2736-446c-961c-d5f8e61cca50 tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1" returned: 0 in 0.872s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-989278e0-2736-446c-961c-d5f8e61cca50 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 2G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-989278e0-2736-446c-961c-d5f8e61cca50 tempest-VolumesExtendTest-1446854052 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 2G" returned: 0 in 0.201s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-989278e0-2736-446c-961c-d5f8e61cca50 tempest-VolumesExtendTest-1446854052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.122s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:01 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-989278e0-2736-446c-961c-d5f8e61cca50 tempest-VolumesExtendTest-1446854052 None] Extend volume completed successfully. Jun 28 14:35:01 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.787s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:01 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:35:01 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Deleted volume successfully. Jun 28 14:35:01 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-00399b85-687a-49d1-9f08-2ad0c91e984f tempest-VolumeDependencyTests-647657300 None] Lock "cinder-5cd84927-130e-49f9-ad23-87374390d2c6-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:02 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Acquiring lock "cinder-73426331-3016-40ee-a0af-1c96a57bf6c4-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:02 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Lock "cinder-73426331-3016-40ee-a0af-1c96a57bf6c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:02 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Acquiring lock "cinder-quobyte-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:02 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Lock "cinder-quobyte-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:02 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Acquiring lock "cinder-quobyte-73426331-3016-40ee-a0af-1c96a57bf6c4" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:02 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Lock "cinder-quobyte-73426331-3016-40ee-a0af-1c96a57bf6c4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Deleting offline snapshot 73426331-3016-40ee-a0af-1c96a57bf6c4 of volume 5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:35:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] snapshot_file for this snap is: volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:35:02 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4cbc84-858d-496b-9335-dfb61ff32624]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:02 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 Jun 28 14:35:02 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:03 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4" returned: 0 in 0.773s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:35:03 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3733f2ad-8bd9-4377-a398-06a18fd6e1ae]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:03 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 Jun 28 14:35:03 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:04 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1" returned: 0 in 0.783s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:04 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 Jun 28 14:35:04 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:04 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4" returned: 0 in 0.781s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:05 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4 Jun 28 14:35:05 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:05 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1.73426331-3016-40ee-a0af-1c96a57bf6c4" returned: 0 in 0.701s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:05 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:UPDATE=184,cinder:DELETE=14,cinder:SELECT=142,cinder:INSERT=48 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:35:05 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=137,cinder:INSERT=45,cinder:UPDATE=160,cinder:DELETE=11 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:35:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Lock "cinder-quobyte-73426331-3016-40ee-a0af-1c96a57bf6c4" released by "_delete_snapshot" :: held 3.155s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Lock "cinder-quobyte-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1" released by "delete_snapshot" :: held 3.179s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:05 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Created reservations ['a949745e-8ed9-4911-8eb2-cb373c3bf0b9', 'cdf23096-9090-46ad-8cf2-51544cc3a29d', '83a5187d-66d1-4a6f-a99a-0cb4ad06e291', '7957faf3-3fe3-4b63-84f4-bd1d8dde36f4'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:35:05 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Delete snapshot completed successfully. Jun 28 14:35:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5dfecab9-92cb-4ddc-a5bf-cd489acfe0ad tempest-VolumesExtendTest-1446854052 None] Lock "cinder-73426331-3016-40ee-a0af-1c96a57bf6c4-delete_snapshot" released by "delete_snapshot" :: held 3.346s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Acquiring lock "cinder-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Lock "cinder-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Acquiring lock "cinder-quobyte-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Lock "cinder-quobyte-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:06 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ec761b-f5bf-4c80-9a21-663e62370628]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:07 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 Jun 28 14:35:07 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:07 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1" returned: 0 in 0.759s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:07 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1 Jun 28 14:35:07 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:08 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1" returned: 0 in 0.680s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:08 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Lock "cinder-quobyte-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1" released by "delete_volume" :: held 1.510s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:08 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Created reservations ['6eb0032c-6453-4f9a-bf1a-56de2dc693e5', '547cd4d3-4da2-4cb4-acd5-c56204947325', 'af447915-0ba8-40b2-bf31-50f3ee54f2ed', '38e3dcd8-7f1a-4e9a-9d05-017c6802aff8'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:35:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:08 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:35:08 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:09 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.769s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:35:09 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Deleted volume successfully. Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2cb2a96b-f8dc-4694-92a3-38f7813970b9 tempest-VolumesExtendTest-1446854052 None] Lock "cinder-5b547c79-2e3a-4162-94e1-6b2bcde1b9a1-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Flow 'volume_create_manager' (7a2c2681-8835-459d-a368-ea08d9c31330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542d7a60-5b5f-4003-94c9-471d80e667f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542d7a60-5b5f-4003-94c9-471d80e667f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1095023976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271ec017-1e10-4cba-9777-50a2dc7edbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0590c2de9dc428aa3c2fc4467c5c192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:09Z,use_quota=True,user_id='42e02d091f93449188d39e2ec4760147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc1d5fe-4cf3-4533-88c5-b86e2814410b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc1d5fe-4cf3-4533-88c5-b86e2814410b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7faf7b9-35bc-4b89-b1c1-25759ed53e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7faf7b9-35bc-4b89-b1c1-25759ed53e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271ec017-1e10-4cba-9777-50a2dc7edbe8', 'volume_name': 'volume-271ec017-1e10-4cba-9777-50a2dc7edbe8', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779ff869-2512-4e09-a0e2-f3c6bd3de3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779ff869-2512-4e09-a0e2-f3c6bd3de3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2dc3b3-ba41-442c-99f2-5b39c1dc49b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:09 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Volume 271ec017-1e10-4cba-9777-50a2dc7edbe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271ec017-1e10-4cba-9777-50a2dc7edbe8', 'volume_size': 1} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1095023976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271ec017-1e10-4cba-9777-50a2dc7edbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0590c2de9dc428aa3c2fc4467c5c192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:09Z,use_quota=True,user_id='42e02d091f93449188d39e2ec4760147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Creating volume 271ec017-1e10-4cba-9777-50a2dc7edbe8 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:35:09 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:35:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-271ec017-1e10-4cba-9777-50a2dc7edbe8 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:09 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-271ec017-1e10-4cba-9777-50a2dc7edbe8 1073741824 Jun 28 14:35:09 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:10 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-271ec017-1e10-4cba-9777-50a2dc7edbe8 1073741824" returned: 0 in 0.947s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-271ec017-1e10-4cba-9777-50a2dc7edbe8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:10 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-271ec017-1e10-4cba-9777-50a2dc7edbe8 Jun 28 14:35:10 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:11 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-271ec017-1e10-4cba-9777-50a2dc7edbe8" returned: 0 in 0.665s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:35:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2dc3b3-ba41-442c-99f2-5b39c1dc49b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271ec017-1e10-4cba-9777-50a2dc7edbe8', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eca50d2-a630-458b-b873-1795fa02e4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:11 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Volume volume-271ec017-1e10-4cba-9777-50a2dc7edbe8 (271ec017-1e10-4cba-9777-50a2dc7edbe8): created successfully Jun 28 14:35:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eca50d2-a630-458b-b873-1795fa02e4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Flow 'volume_create_manager' (7a2c2681-8835-459d-a368-ea08d9c31330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:11 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-aa689552-9593-427b-9aca-9305cf1abc31 tempest-VolumeQuotasAdminTestJSON-665409212 None] Created volume successfully. Jun 28 14:35:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Acquiring lock "cinder-271ec017-1e10-4cba-9777-50a2dc7edbe8-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Lock "cinder-271ec017-1e10-4cba-9777-50a2dc7edbe8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Acquiring lock "cinder-quobyte-271ec017-1e10-4cba-9777-50a2dc7edbe8" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Lock "cinder-quobyte-271ec017-1e10-4cba-9777-50a2dc7edbe8" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:11 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f34f95-ad3c-4232-9c7c-ae6610e051b2]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-271ec017-1e10-4cba-9777-50a2dc7edbe8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:11 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-271ec017-1e10-4cba-9777-50a2dc7edbe8 Jun 28 14:35:11 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:11 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Flow 'volume_create_manager' (ba118e4c-a5ff-443a-a68c-87862cbaad34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2f2b8b-254a-43b0-a5c9-8a2e4ccf8c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2f2b8b-254a-43b0-a5c9-8a2e4ccf8c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1422306556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce58e866-1b1e-47e3-bfdc-a6435446b6cd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e9ebfd2d4954a038784af8fae9a88bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:12Z,use_quota=True,user_id='ebd19413ca804b2ba5097401350b6ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd972aed-fe91-4057-91be-ff2699322654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd972aed-fe91-4057-91be-ff2699322654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81310902-2513-4be6-a4cb-519240fea328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81310902-2513-4be6-a4cb-519240fea328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce58e866-1b1e-47e3-bfdc-a6435446b6cd', 'volume_name': 'volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a51dc7-1b08-4a03-a4a9-66bcfbeaf7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a51dc7-1b08-4a03-a4a9-66bcfbeaf7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bdaafa-4a88-492b-9065-43d6a6f6d393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:12 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Volume ce58e866-1b1e-47e3-bfdc-a6435446b6cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd', 'volume_size': 1} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1422306556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce58e866-1b1e-47e3-bfdc-a6435446b6cd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e9ebfd2d4954a038784af8fae9a88bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:12Z,use_quota=True,user_id='ebd19413ca804b2ba5097401350b6ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Creating volume ce58e866-1b1e-47e3-bfdc-a6435446b6cd {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:35:12 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:12 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd 1073741824 Jun 28 14:35:12 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:12 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-271ec017-1e10-4cba-9777-50a2dc7edbe8" returned: 0 in 0.770s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-271ec017-1e10-4cba-9777-50a2dc7edbe8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:12 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-271ec017-1e10-4cba-9777-50a2dc7edbe8 Jun 28 14:35:12 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:12 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd 1073741824" returned: 0 in 0.826s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:12 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd Jun 28 14:35:12 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:13 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-271ec017-1e10-4cba-9777-50a2dc7edbe8" returned: 0 in 0.668s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Lock "cinder-quobyte-271ec017-1e10-4cba-9777-50a2dc7edbe8" released by "delete_volume" :: held 1.487s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Created reservations ['4040ec14-bfb6-47c6-b62a-31d5b2b5766c', '0b193dfa-2fe2-4146-8599-ee39a37e4960', '3a0434b9-5f31-4623-b3bf-501d06b4452f', '26e21b70-42e3-4bb1-98cd-0fd7ece7578e'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:13 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:35:13 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:13 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd" returned: 0 in 0.665s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bdaafa-4a88-492b-9065-43d6a6f6d393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbf306c-c5f4-4b90-83f3-30795d2771a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:13 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Volume volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd (ce58e866-1b1e-47e3-bfdc-a6435446b6cd): created successfully Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbf306c-c5f4-4b90-83f3-30795d2771a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Flow 'volume_create_manager' (ba118e4c-a5ff-443a-a68c-87862cbaad34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:13 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-2d440a57-d31e-473c-88b2-2c8fa833a31f tempest-VolumesGetTest-1977329399 None] Created volume successfully. Jun 28 14:35:13 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.648s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:35:13 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Deleted volume successfully. Jun 28 14:35:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-60241a60-f4dd-48a4-a052-72164df8558d tempest-VolumeQuotasAdminTestJSON-665409212 None] Lock "cinder-271ec017-1e10-4cba-9777-50a2dc7edbe8-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Flow 'volume_create_manager' (749fccac-92bb-4f6f-aaa8-781f5a3015ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e5550e-1274-490c-bfdb-073fb0a87b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e5550e-1274-490c-bfdb-073fb0a87b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2027674184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c776d4-7799-4a02-bfa0-e837a31b97d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0590c2de9dc428aa3c2fc4467c5c192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:14Z,use_quota=True,user_id='42e02d091f93449188d39e2ec4760147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f81db83-d994-4633-9d55-ec052a25ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f81db83-d994-4633-9d55-ec052a25ce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7681177-7e6a-4384-9673-dc53d6661822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7681177-7e6a-4384-9673-dc53d6661822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22c776d4-7799-4a02-bfa0-e837a31b97d4', 'volume_name': 'volume-22c776d4-7799-4a02-bfa0-e837a31b97d4', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf09764-47d3-4b9f-9d6b-a66ea56ec422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf09764-47d3-4b9f-9d6b-a66ea56ec422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e294eacc-f904-4887-9e49-e0506d0b5a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:14 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Volume 22c776d4-7799-4a02-bfa0-e837a31b97d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22c776d4-7799-4a02-bfa0-e837a31b97d4', 'volume_size': 1} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2027674184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c776d4-7799-4a02-bfa0-e837a31b97d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0590c2de9dc428aa3c2fc4467c5c192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:14Z,use_quota=True,user_id='42e02d091f93449188d39e2ec4760147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Creating volume 22c776d4-7799-4a02-bfa0-e837a31b97d4 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:35:14 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-22c776d4-7799-4a02-bfa0-e837a31b97d4 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:14 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-22c776d4-7799-4a02-bfa0-e837a31b97d4 1073741824 Jun 28 14:35:14 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Flow 'volume_create_manager' (89b631db-c312-4f71-b220-9bfcf6316bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce577c35-6f58-402a-a74a-775f421ed9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce577c35-6f58-402a-a74a-775f421ed9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1688595628',display_name='tempest-VolumesGetTest-Volume-1142797921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7da50b1-02b0-4fef-af53-2b14a46b87c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e9ebfd2d4954a038784af8fae9a88bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:15Z,use_quota=True,user_id='ebd19413ca804b2ba5097401350b6ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89fc674-9759-4f43-8b10-4c5d82933cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89fc674-9759-4f43-8b10-4c5d82933cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b884c7c-eae8-4eeb-a9d2-bf7e911dbf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b884c7c-eae8-4eeb-a9d2-bf7e911dbf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7da50b1-02b0-4fef-af53-2b14a46b87c6', 'volume_name': 'volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9b0575-4dd9-42e2-892c-d68848204a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9b0575-4dd9-42e2-892c-d68848204a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32281772-8561-48bd-bc14-de110cd29cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:14 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Volume c7da50b1-02b0-4fef-af53-2b14a46b87c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6', 'volume_size': 1} Jun 28 14:35:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:15 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-22c776d4-7799-4a02-bfa0-e837a31b97d4 1073741824" returned: 0 in 0.822s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-22c776d4-7799-4a02-bfa0-e837a31b97d4 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:15 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-22c776d4-7799-4a02-bfa0-e837a31b97d4 Jun 28 14:35:15 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:15 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-22c776d4-7799-4a02-bfa0-e837a31b97d4" returned: 0 in 0.622s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.975s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1688595628',display_name='tempest-VolumesGetTest-Volume-1142797921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7da50b1-02b0-4fef-af53-2b14a46b87c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e9ebfd2d4954a038784af8fae9a88bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:15Z,use_quota=True,user_id='ebd19413ca804b2ba5097401350b6ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Creating volume c7da50b1-02b0-4fef-af53-2b14a46b87c6 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:35:15 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:15 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6 1073741824 Jun 28 14:35:15 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e294eacc-f904-4887-9e49-e0506d0b5a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22c776d4-7799-4a02-bfa0-e837a31b97d4', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc67d621-223b-45a7-a60b-dc702300bcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:15 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Volume volume-22c776d4-7799-4a02-bfa0-e837a31b97d4 (22c776d4-7799-4a02-bfa0-e837a31b97d4): created successfully Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc67d621-223b-45a7-a60b-dc702300bcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Flow 'volume_create_manager' (749fccac-92bb-4f6f-aaa8-781f5a3015ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:15 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-66fab76e-a3e2-451b-96a6-7720173c6db4 tempest-VolumeQuotasAdminTestJSON-665409212 None] Created volume successfully. Jun 28 14:35:16 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6 1073741824" returned: 0 in 0.813s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:16 devstack sudo[108843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6 Jun 28 14:35:16 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:16 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-5c65dfdf-544f-4f37-8d5f-8f9cbfdae525 tempest-VolumeQuotasAdminTestJSON-1925238025 None] Transfer volume completed successfully. Jun 28 14:35:17 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6" returned: 0 in 0.649s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:35:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32281772-8561-48bd-bc14-de110cd29cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3503f7-feed-4302-a45c-f2f9c414ea98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:17 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Volume volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6 (c7da50b1-02b0-4fef-af53-2b14a46b87c6): created successfully Jun 28 14:35:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3503f7-feed-4302-a45c-f2f9c414ea98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Flow 'volume_create_manager' (89b631db-c312-4f71-b220-9bfcf6316bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:17 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-75875274-a578-4c90-86e2-8d27ee397a90 tempest-VolumesGetTest-1977329399 None] Created volume successfully. Jun 28 14:35:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Acquiring lock "cinder-22c776d4-7799-4a02-bfa0-e837a31b97d4-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Lock "cinder-22c776d4-7799-4a02-bfa0-e837a31b97d4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Acquiring lock "cinder-quobyte-22c776d4-7799-4a02-bfa0-e837a31b97d4" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Lock "cinder-quobyte-22c776d4-7799-4a02-bfa0-e837a31b97d4" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:17 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[983cd763-317b-4ab7-83de-f51d7b2fadb9]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-22c776d4-7799-4a02-bfa0-e837a31b97d4 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:17 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-22c776d4-7799-4a02-bfa0-e837a31b97d4 Jun 28 14:35:17 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-c7da50b1-02b0-4fef-af53-2b14a46b87c6-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Lock "cinder-c7da50b1-02b0-4fef-af53-2b14a46b87c6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-quobyte-c7da50b1-02b0-4fef-af53-2b14a46b87c6" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:18 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-c7da50b1-02b0-4fef-af53-2b14a46b87c6" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:18 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f667f57-beb0-471c-b001-a73f5bf28a1b]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:18 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6 Jun 28 14:35:18 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:18 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-22c776d4-7799-4a02-bfa0-e837a31b97d4" returned: 0 in 0.762s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-22c776d4-7799-4a02-bfa0-e837a31b97d4 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:18 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-22c776d4-7799-4a02-bfa0-e837a31b97d4 Jun 28 14:35:18 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:18 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6" returned: 0 in 0.774s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:18 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6 Jun 28 14:35:18 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:19 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-22c776d4-7799-4a02-bfa0-e837a31b97d4" returned: 0 in 0.659s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Lock "cinder-quobyte-22c776d4-7799-4a02-bfa0-e837a31b97d4" released by "delete_volume" :: held 1.463s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Created reservations ['159da2ae-6215-43da-a96e-6c8c9367beef', '23e40a87-33a9-4b64-93dd-90232bec7c7f', 'c1bd3130-185a-4ed4-ab3b-df8f33b918ba', '5afaa61e-4f7e-49b8-bf3b-7512564dd63c'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:19 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:35:19 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:19 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c7da50b1-02b0-4fef-af53-2b14a46b87c6" returned: 0 in 0.647s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-c7da50b1-02b0-4fef-af53-2b14a46b87c6" released by "delete_volume" :: held 1.467s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Created reservations ['f17c06a4-a304-4bfc-b1b0-3fe00a275061', '5fa9ff7e-a603-4e6e-b20a-d7eae5eb8b02', '8027d99f-1ee6-43cd-bc2e-926d034e4dea', 'bda42254-9dd3-4768-998f-36a4d019d806'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:19 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:35:19 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:20 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.674s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:20 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:35:20 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Deleted volume successfully. Jun 28 14:35:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4375b319-3025-488b-907f-02db7df24de0 tempest-VolumeQuotasAdminTestJSON-1200929563 None] Lock "cinder-22c776d4-7799-4a02-bfa0-e837a31b97d4-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-ce58e866-1b1e-47e3-bfdc-a6435446b6cd-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Lock "cinder-ce58e866-1b1e-47e3-bfdc-a6435446b6cd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:20 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.683s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:20 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:35:20 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Deleted volume successfully. Jun 28 14:35:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-quobyte-ce58e866-1b1e-47e3-bfdc-a6435446b6cd" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a203781e-5d4f-46da-a8de-fddfa14a4691 tempest-VolumesGetTest-1977329399 None] Lock "cinder-c7da50b1-02b0-4fef-af53-2b14a46b87c6-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-ce58e866-1b1e-47e3-bfdc-a6435446b6cd" acquired by "delete_volume" :: waited 0.020s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:20 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1e9d6f-f23c-4c4e-a3f6-865308a970bd]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:20 devstack sudo[108874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd Jun 28 14:35:20 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:21 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd" returned: 0 in 0.791s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:21 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd Jun 28 14:35:21 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:21 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce58e866-1b1e-47e3-bfdc-a6435446b6cd" returned: 0 in 0.711s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-ce58e866-1b1e-47e3-bfdc-a6435446b6cd" released by "delete_volume" :: held 1.552s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:22 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Created reservations ['72707c36-e2ea-4f7b-b424-0f8da3564f76', '3b564383-b9ea-47a5-ba22-3958b11e7879', 'cd9a6ebb-795d-43e1-b351-e077c24fa4e0', 'e61115a6-27e7-4658-815c-2490d7dc42c8'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:35:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:22 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:35:22 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:22 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.746s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:22 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:35:22 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Deleted volume successfully. Jun 28 14:35:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-eeec8648-7f98-4e3a-8ee2-a40701ec17a5 tempest-VolumesGetTest-1977329399 None] Lock "cinder-ce58e866-1b1e-47e3-bfdc-a6435446b6cd-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Flow 'volume_create_manager' (4cf77d8c-42ee-4fd7-815e-ea9a2ac22517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15d7250-ba4b-4f91-b0da-b90d4648ae0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15d7250-ba4b-4f91-b0da-b90d4648ae0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1862093825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01c8568-a2ff-4f59-a78e-a882438ce15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e9ebfd2d4954a038784af8fae9a88bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:23Z,use_quota=True,user_id='ebd19413ca804b2ba5097401350b6ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c27db4a-3741-44ee-9f36-25df7ea04a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c27db4a-3741-44ee-9f36-25df7ea04a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e3e1c9-6cb2-43a8-9502-4b7a802e150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e3e1c9-6cb2-43a8-9502-4b7a802e150c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01c8568-a2ff-4f59-a78e-a882438ce15b', 'volume_name': 'volume-a01c8568-a2ff-4f59-a78e-a882438ce15b', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cce2843-3070-43fe-afd1-3a43bddbae3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cce2843-3070-43fe-afd1-3a43bddbae3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19aedf3b-2f5a-4e3a-a899-45d05ac22bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:23 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Volume a01c8568-a2ff-4f59-a78e-a882438ce15b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01c8568-a2ff-4f59-a78e-a882438ce15b', 'volume_size': 1} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1862093825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01c8568-a2ff-4f59-a78e-a882438ce15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e9ebfd2d4954a038784af8fae9a88bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:23Z,use_quota=True,user_id='ebd19413ca804b2ba5097401350b6ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Creating volume a01c8568-a2ff-4f59-a78e-a882438ce15b {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:35:23 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:35:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:23 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b 1073741824 Jun 28 14:35:23 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:24 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b 1073741824" returned: 0 in 0.861s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:24 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b Jun 28 14:35:24 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:24 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b" returned: 0 in 0.671s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:35:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19aedf3b-2f5a-4e3a-a899-45d05ac22bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01c8568-a2ff-4f59-a78e-a882438ce15b', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c8a505-1f2b-4a40-a933-e314f8d53d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:24 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Volume volume-a01c8568-a2ff-4f59-a78e-a882438ce15b (a01c8568-a2ff-4f59-a78e-a882438ce15b): created successfully Jun 28 14:35:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c8a505-1f2b-4a40-a933-e314f8d53d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Flow 'volume_create_manager' (4cf77d8c-42ee-4fd7-815e-ea9a2ac22517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:24 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-410f641c-d357-4fa1-bf5c-75392743a4e7 tempest-VolumesGetTest-1977329399 None] Created volume successfully. Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Flow 'volume_create_manager' (d08d4377-ef55-48e6-acdb-3ed43326e304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc3727b-e7eb-4d0b-9512-26a5126139d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc3727b-e7eb-4d0b-9512-26a5126139d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-199099922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60d2b1e-c59a-4310-895f-ca7731b43e6f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e9ebfd2d4954a038784af8fae9a88bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a01c8568-a2ff-4f59-a78e-a882438ce15b,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:26Z,use_quota=True,user_id='ebd19413ca804b2ba5097401350b6ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a29d1d-1a8c-421f-a903-b7f3e29b5c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a29d1d-1a8c-421f-a903-b7f3e29b5c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289c502a-531a-482e-8895-ae458b66b667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289c502a-531a-482e-8895-ae458b66b667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f60d2b1e-c59a-4310-895f-ca7731b43e6f', 'volume_name': 'volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f', 'volume_size': 1, 'source_volid': 'a01c8568-a2ff-4f59-a78e-a882438ce15b', 'source_volstatus': 'available'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f5dedb-4e54-4303-b30a-bb311f5a7983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f5dedb-4e54-4303-b30a-bb311f5a7983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12aa8626-7dab-4d32-ad73-6397a8ca8e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:25 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Volume f60d2b1e-c59a-4310-895f-ca7731b43e6f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f', 'volume_size': 1, 'source_volid': 'a01c8568-a2ff-4f59-a78e-a882438ce15b', 'source_volstatus': 'available'} Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:25 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Cloning volume a01c8568-a2ff-4f59-a78e-a882438ce15b to volume f60d2b1e-c59a-4310-895f-ca7731b43e6f Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Creating offline snapshot f7a8c656-7def-45ad-b817-8f4c60fe487d of volume a01c8568-a2ff-4f59-a78e-a882438ce15b {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8d8a10-aeca-40c6-846c-f58445ece0d4]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:25 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b Jun 28 14:35:25 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:26 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b" returned: 0 in 0.804s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:26 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d 1G Jun 28 14:35:26 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:26 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:35:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Flow 'volume_create_manager' (80405c32-8e45-4f09-9223-e321924ee8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c0690f-1cd7-4739-85c4-5733b52d7f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c0690f-1cd7-4739-85c4-5733b52d7f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1802122507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a14b1b-bb04-4a86-872e-87aa8834165d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b86099f7d9540ce88af6b62526cc31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:27Z,use_quota=True,user_id='01509ba4c3f34b1ca262eca1d1ce6635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44e8d006-3c53-4afe-a49f-8c26dfe95ded),volume_type_id=44e8d006-3c53-4afe-a49f-8c26dfe95ded)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83089c1-5cd9-4f9f-ac16-62f169ffa659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83089c1-5cd9-4f9f-ac16-62f169ffa659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d29f10-be32-46a7-9a59-3c52698bd290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d29f10-be32-46a7-9a59-3c52698bd290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a14b1b-bb04-4a86-872e-87aa8834165d', 'volume_name': 'volume-52a14b1b-bb04-4a86-872e-87aa8834165d', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55583013-1889-417d-9e2a-2ba953fe6b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55583013-1889-417d-9e2a-2ba953fe6b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796c36d1-a8e7-4300-95b5-01d9c428d0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:26 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Volume 52a14b1b-bb04-4a86-872e-87aa8834165d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a14b1b-bb04-4a86-872e-87aa8834165d', 'volume_size': 1} Jun 28 14:35:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:27 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d 1G" returned: 0 in 0.802s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a01c8568-a2ff-4f59-a78e-a882438ce15b -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:27 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a01c8568-a2ff-4f59-a78e-a882438ce15b -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d Jun 28 14:35:27 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:28 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a01c8568-a2ff-4f59-a78e-a882438ce15b -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d" returned: 0 in 0.685s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:28 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d is being set with open permissions: ugo+rw Jun 28 14:35:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:28 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d Jun 28 14:35:28 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:28 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d" returned: 0 in 0.622s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:28 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.info Jun 28 14:35:28 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:29 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.info" returned: 0 in 0.635s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:29 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.info is being set with open permissions: ugo+rw Jun 28 14:35:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:29 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.info Jun 28 14:35:29 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:29 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.info" returned: 0 in 0.631s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-quobyte-f60d2b1e-c59a-4310-895f-ca7731b43e6f" by "_copy_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-f60d2b1e-c59a-4310-895f-ca7731b43e6f" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] snapshot: f7a8c656-7def-45ad-b817-8f4c60fe487d, volume: f60d2b1e-c59a-4310-895f-ca7731b43e6f, {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 28 14:35:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:30 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4008b3-f360-4ad2-bf45-c5cdc056b38f]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:30 devstack sudo[108922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d Jun 28 14:35:30 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:30 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d" returned: 0 in 0.727s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a01c8568-a2ff-4f59-a78e-a882438ce15b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:35:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 28 14:35:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Creating direct copy from snapshot {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 28 14:35:30 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f881ea-7057-475e-81a9-bc04b0d1906a]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:30 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b Jun 28 14:35:30 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:31 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b" returned: 0 in 0.778s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:31 devstack cinder-volume[93561]: DEBUG cinder.utils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Path /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f not found in is_blk_device check {{(pid=93561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 28 14:35:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:31 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f Jun 28 14:35:31 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:36 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f" returned: 0 in 4.535s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:36 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7846ee-9060-4d9c-9a3a-09df86d29fb6]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:36 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b Jun 28 14:35:36 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:37 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b" returned: 0 in 0.938s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Image conversion details: src /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:35:37 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Converted 1024.00 MB image at 225.73 MB/s Jun 28 14:35:37 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f is being set with open permissions: ugo+rw Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:37 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f Jun 28 14:35:37 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:37 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f" returned: 0 in 0.642s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-f60d2b1e-c59a-4310-895f-ca7731b43e6f" released by "_copy_volume_from_snapshot" :: held 7.697s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-quobyte-f7a8c656-7def-45ad-b817-8f4c60fe487d" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-f7a8c656-7def-45ad-b817-8f4c60fe487d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Deleting offline snapshot f7a8c656-7def-45ad-b817-8f4c60fe487d of volume a01c8568-a2ff-4f59-a78e-a882438ce15b {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] snapshot_file for this snap is: volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05648af-cd9e-4f9d-aa35-a20173cb84b3]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:37 devstack sudo[108954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:35:37 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:37 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d Jun 28 14:35:37 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:38 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.633s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:35:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:35:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 28 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:35:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:35:38 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d" returned: 0 in 0.767s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:38 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a01c8568-a2ff-4f59-a78e-a882438ce15b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:35:38 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad70d26e-48e3-4503-bd29-ab7a7fdc1d6a]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:38 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b Jun 28 14:35:38 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:38 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=56,cinder:INSERT=19,cinder:UPDATE=64,cinder:DELETE=5 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:35:39 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b" returned: 0 in 0.745s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:39 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d Jun 28 14:35:39 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:40 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d" returned: 0 in 0.723s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:40 devstack sudo[108973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d Jun 28 14:35:40 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:40 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b.f7a8c656-7def-45ad-b817-8f4c60fe487d" returned: 0 in 0.632s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-f7a8c656-7def-45ad-b817-8f4c60fe487d" released by "_delete_snapshot" :: held 2.949s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.003s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.855s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1802122507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a14b1b-bb04-4a86-872e-87aa8834165d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b86099f7d9540ce88af6b62526cc31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:27Z,use_quota=True,user_id='01509ba4c3f34b1ca262eca1d1ce6635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44e8d006-3c53-4afe-a49f-8c26dfe95ded),volume_type_id=44e8d006-3c53-4afe-a49f-8c26dfe95ded)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Creating volume 52a14b1b-bb04-4a86-872e-87aa8834165d {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:35:40 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-52a14b1b-bb04-4a86-872e-87aa8834165d 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12aa8626-7dab-4d32-ad73-6397a8ca8e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f', 'volume_size': 1, 'source_volid': 'a01c8568-a2ff-4f59-a78e-a882438ce15b', 'source_volstatus': 'available'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:40 devstack sudo[108976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-52a14b1b-bb04-4a86-872e-87aa8834165d 1073741824 Jun 28 14:35:40 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b86893-b375-45aa-8825-a962cca857f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:40 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Volume volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f (f60d2b1e-c59a-4310-895f-ca7731b43e6f): created successfully Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b86893-b375-45aa-8825-a962cca857f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Flow 'volume_create_manager' (d08d4377-ef55-48e6-acdb-3ed43326e304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:40 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f6a79c67-3953-4fcb-b5ef-d778022cda5a tempest-VolumesGetTest-1977329399 None] Created volume successfully. Jun 28 14:35:41 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-52a14b1b-bb04-4a86-872e-87aa8834165d 1073741824" returned: 0 in 0.813s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-52a14b1b-bb04-4a86-872e-87aa8834165d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:41 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-52a14b1b-bb04-4a86-872e-87aa8834165d Jun 28 14:35:41 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:42 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-52a14b1b-bb04-4a86-872e-87aa8834165d" returned: 0 in 0.690s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796c36d1-a8e7-4300-95b5-01d9c428d0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a14b1b-bb04-4a86-872e-87aa8834165d', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd63b64-9181-443e-bf7b-e45f9ae8af80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:42 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Volume volume-52a14b1b-bb04-4a86-872e-87aa8834165d (52a14b1b-bb04-4a86-872e-87aa8834165d): created successfully Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd63b64-9181-443e-bf7b-e45f9ae8af80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Flow 'volume_create_manager' (80405c32-8e45-4f09-9223-e321924ee8c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:42 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-5ec7419b-c159-4161-9d4c-1c402d2a2d4d tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Created volume successfully. Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Flow 'volume_create_manager' (c97763b0-a947-4e79-871b-6849bbec4709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d45c973-eff9-46df-8557-c138bc9f8e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d45c973-eff9-46df-8557-c138bc9f8e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-317286324',display_name='tempest-VolumesGetTest-Volume-396116748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e9ebfd2d4954a038784af8fae9a88bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:42Z,use_quota=True,user_id='ebd19413ca804b2ba5097401350b6ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08b2f46-2053-4699-87ca-95935c387413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08b2f46-2053-4699-87ca-95935c387413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4afd55-4938-429f-b302-931cad17694f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4afd55-4938-429f-b302-931cad17694f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62', 'volume_name': 'volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74e003b-2eed-4e70-b54d-bcc208d3114f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74e003b-2eed-4e70-b54d-bcc208d3114f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6297c4-481e-4d4a-b34c-4ed40803ad28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:42 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Volume 1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62', 'volume_size': 1} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-317286324',display_name='tempest-VolumesGetTest-Volume-396116748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e9ebfd2d4954a038784af8fae9a88bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:42Z,use_quota=True,user_id='ebd19413ca804b2ba5097401350b6ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Creating volume 1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:35:42 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:35:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:42 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62 1073741824 Jun 28 14:35:42 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a35d6186-6bae-4761-a4db-ad23f77c20da tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a35d6186-6bae-4761-a4db-ad23f77c20da tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a35d6186-6bae-4761-a4db-ad23f77c20da tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a35d6186-6bae-4761-a4db-ad23f77c20da tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a35d6186-6bae-4761-a4db-ad23f77c20da tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a35d6186-6bae-4761-a4db-ad23f77c20da tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:43 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:35:43 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:43 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62 1073741824" returned: 0 in 0.863s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:43 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62 Jun 28 14:35:43 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:43 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a35d6186-6bae-4761-a4db-ad23f77c20da tempest-VolumeRetypeWithoutMigrationTest-640571785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.665s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:43 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a35d6186-6bae-4761-a4db-ad23f77c20da tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:35:43 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a35d6186-6bae-4761-a4db-ad23f77c20da tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Retype volume completed successfully. Jun 28 14:35:44 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62" returned: 0 in 0.659s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6297c4-481e-4d4a-b34c-4ed40803ad28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e91f2d-36ea-446a-947d-6680ab1bbf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:44 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Volume volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62 (1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62): created successfully Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e91f2d-36ea-446a-947d-6680ab1bbf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Flow 'volume_create_manager' (c97763b0-a947-4e79-871b-6849bbec4709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:44 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-51318870-203b-42eb-acc3-66047ebef869 tempest-VolumesGetTest-1977329399 None] Created volume successfully. Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Acquiring lock "cinder-52a14b1b-bb04-4a86-872e-87aa8834165d-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Lock "cinder-52a14b1b-bb04-4a86-872e-87aa8834165d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Acquiring lock "cinder-quobyte-52a14b1b-bb04-4a86-872e-87aa8834165d" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Lock "cinder-quobyte-52a14b1b-bb04-4a86-872e-87aa8834165d" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1204995e-bec3-46e3-83be-02605734ad00]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-52a14b1b-bb04-4a86-872e-87aa8834165d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:44 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-52a14b1b-bb04-4a86-872e-87aa8834165d Jun 28 14:35:44 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Lock "cinder-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-quobyte-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c2da28-7dae-4f3c-96a5-f236e5d87f2e]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:44 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62 Jun 28 14:35:44 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:45 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-52a14b1b-bb04-4a86-872e-87aa8834165d" returned: 0 in 0.771s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-52a14b1b-bb04-4a86-872e-87aa8834165d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:45 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-52a14b1b-bb04-4a86-872e-87aa8834165d Jun 28 14:35:45 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:45 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62" returned: 0 in 0.776s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:45 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62 Jun 28 14:35:45 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:45 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-52a14b1b-bb04-4a86-872e-87aa8834165d" returned: 0 in 0.644s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:45 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Lock "cinder-quobyte-52a14b1b-bb04-4a86-872e-87aa8834165d" released by "delete_volume" :: held 1.461s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:45 devstack cinder-volume[93561]: WARNING cinder.quota [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:35:45 devstack cinder-volume[93561]: WARNING cinder.quota [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Created reservations ['daa11ff8-0ad9-4562-920c-b8087c553bbd', 'b65810c2-dfdb-4411-8069-c0f71c791bef', '350be28d-3afb-4498-b7e6-e067cf4dbe06', '5da3750c-3129-4b39-93ff-01e0393968b3'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:46 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:35:46 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:46 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62" returned: 0 in 0.687s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62" released by "delete_volume" :: held 1.501s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Created reservations ['ee0c6f01-2f8f-4cd9-8abf-a2996c8f6047', 'c0153860-19d6-46cb-9275-ee84d63aeafe', '4935cdec-947c-44b1-8adc-204999f558ae', '86da3bd5-1b70-4414-8ec0-0b64ff8650ce'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:46 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:35:46 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:46 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.631s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:35:46 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Deleted volume successfully. Jun 28 14:35:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-9d6250dc-660b-47a5-b4ef-8f63f627c616 tempest-VolumeRetypeWithoutMigrationTest-640571785 None] Lock "cinder-52a14b1b-bb04-4a86-872e-87aa8834165d-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-f60d2b1e-c59a-4310-895f-ca7731b43e6f-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:47 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.699s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:47 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:35:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Lock "cinder-f60d2b1e-c59a-4310-895f-ca7731b43e6f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:47 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Deleted volume successfully. Jun 28 14:35:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e029ab10-0ab6-45a2-a93a-4d0f2193dfeb tempest-VolumesGetTest-1977329399 None] Lock "cinder-1f6ff9dc-91dc-4457-b76f-b0fbef7b7a62-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-quobyte-f60d2b1e-c59a-4310-895f-ca7731b43e6f" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-f60d2b1e-c59a-4310-895f-ca7731b43e6f" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:47 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3eea82-0dd4-4d6d-b4e2-0142380cb141]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:47 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f Jun 28 14:35:47 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:47 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f" returned: 0 in 0.764s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:47 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f Jun 28 14:35:47 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:48 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f60d2b1e-c59a-4310-895f-ca7731b43e6f" returned: 0 in 0.698s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-f60d2b1e-c59a-4310-895f-ca7731b43e6f" released by "delete_volume" :: held 1.509s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:48 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Created reservations ['ec73ce2a-4074-4089-a8c1-28e67be866e3', '88ff184f-ce60-440d-8e22-5e746514aa18', '0d4c18f9-51af-43d3-84b7-561f83579ab1', '81231ce6-374d-4ced-b216-d201e58ef58b'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:35:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:48 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:35:48 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-a01c8568-a2ff-4f59-a78e-a882438ce15b-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Lock "cinder-a01c8568-a2ff-4f59-a78e-a882438ce15b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-quobyte-a01c8568-a2ff-4f59-a78e-a882438ce15b" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:35:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-a01c8568-a2ff-4f59-a78e-a882438ce15b" acquired by "delete_volume" :: waited 0.020s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:35:49 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.711s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:49 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:35:49 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Deleted volume successfully. Jun 28 14:35:49 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc5c9c4-6f13-4e83-a150-18e44493673d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-eff91c28-16f1-4348-ae3d-06933115cc66 tempest-VolumesGetTest-1977329399 None] Lock "cinder-f60d2b1e-c59a-4310-895f-ca7731b43e6f-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:49 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b Jun 28 14:35:49 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:50 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b" returned: 0 in 0.779s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:50 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b Jun 28 14:35:50 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:51 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a01c8568-a2ff-4f59-a78e-a882438ce15b" returned: 0 in 0.668s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-a01c8568-a2ff-4f59-a78e-a882438ce15b" released by "delete_volume" :: held 1.520s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Created reservations ['8f940130-c5da-4775-ad34-7d0c52f896ad', '5492133f-5a4e-4d48-a064-42b8d743129c', 'a68e8285-1d1f-48ac-8738-85d0c10bf118', '9fb020d2-6bb1-4327-bfa0-6318878342d3'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:51 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:35:51 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Flow 'volume_create_manager' (f4cdc839-574c-4cba-a8ac-448b1350092f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb930e3d-2bbb-4898-b363-7da90dcf75cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb930e3d-2bbb-4898-b363-7da90dcf75cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2086348432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3153998-9061-427c-9bc4-25a6e83eee6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e78ff94e544ccc80babbf33c6491fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:51Z,use_quota=True,user_id='0d978b1bb7c34d03bf263a589d797d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5deae56-2c16-4194-9a8b-685539e758a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5deae56-2c16-4194-9a8b-685539e758a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4a3913-cee7-46d3-8bd4-da45f7479a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.image.glance [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Creating Keystone auth plugin from conf {{(pid=93561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4a3913-cee7-46d3-8bd4-da45f7479a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f3153998-9061-427c-9bc4-25a6e83eee6e', 'volume_name': 'volume-f3153998-9061-427c-9bc4-25a6e83eee6e', 'volume_size': 1, 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e2aafa849d4b7590b8e84dddedb04b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'created_at': datetime.datetime(2026, 6, 28, 12, 14, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 14, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae7ea69-4e18-4468-8c3f-96c2f9ee92be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae7ea69-4e18-4468-8c3f-96c2f9ee92be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eab6430-87fa-427e-bd73-9d60b796d243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:51 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Volume f3153998-9061-427c-9bc4-25a6e83eee6e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f3153998-9061-427c-9bc4-25a6e83eee6e', 'volume_size': 1, 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e2aafa849d4b7590b8e84dddedb04b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'created_at': datetime.datetime(2026, 6, 28, 12, 14, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 14, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Trying to clone f3153998-9061-427c-9bc4-25a6e83eee6e from image dfdfa247-b97d-4fd5-928f-a01fae72e0ac at location (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]). {{(pid=93561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 28 14:35:51 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.738s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:51 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:35:51 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Deleted volume successfully. Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d1565e14-5ae2-47d0-b8f7-fee3ceeb2897 tempest-VolumesGetTest-1977329399 None] Lock "cinder-a01c8568-a2ff-4f59-a78e-a882438ce15b-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_mnhw13eidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 28 14:35:52 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Image download 20.69 MB at 20.69 MB/s Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[105edeb7-4d8e-4962-8886-defa4babc117]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_mnhw13eidevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:52 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_mnhw13eidevstack@QuobyteHD Jun 28 14:35:52 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Flow 'volume_create_manager' (da639a23-4199-4a3d-886b-97018a666568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c404c012-557d-4405-b5d3-3cdbbaa67f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c404c012-557d-4405-b5d3-3cdbbaa67f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1769115413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f01acb-c181-4bed-8a37-b65eeeb93390,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e9ebfd2d4954a038784af8fae9a88bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:52Z,use_quota=True,user_id='ebd19413ca804b2ba5097401350b6ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df156359-c8b9-4140-9599-4f6eabbe665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df156359-c8b9-4140-9599-4f6eabbe665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3999fc-61b9-43f7-9ddb-3f2879131f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.image.glance [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Creating Keystone auth plugin from conf {{(pid=93561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3999fc-61b9-43f7-9ddb-3f2879131f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a1f01acb-c181-4bed-8a37-b65eeeb93390', 'volume_name': 'volume-a1f01acb-c181-4bed-8a37-b65eeeb93390', 'volume_size': 1, 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e2aafa849d4b7590b8e84dddedb04b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'created_at': datetime.datetime(2026, 6, 28, 12, 14, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 14, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80f7aa4-09dc-443c-9f77-d768d18939e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80f7aa4-09dc-443c-9f77-d768d18939e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d117ae9e-0791-4046-83c2-48739edf46bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:35:52 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Volume a1f01acb-c181-4bed-8a37-b65eeeb93390: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a1f01acb-c181-4bed-8a37-b65eeeb93390', 'volume_size': 1, 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e2aafa849d4b7590b8e84dddedb04b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'created_at': datetime.datetime(2026, 6, 28, 12, 14, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 14, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Trying to clone a1f01acb-c181-4bed-8a37-b65eeeb93390 from image dfdfa247-b97d-4fd5-928f-a01fae72e0ac at location (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]). {{(pid=93561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 28 14:35:52 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_mnhw13eidevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Temporary image dfdfa247-b97d-4fd5-928f-a01fae72e0ac is fetched for user 0d978b1bb7c34d03bf263a589d797d84. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[de65055b-48b9-495b-8bda-77094c41c698]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_mnhw13eidevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_wa3n1dvadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 28 14:35:53 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Image download 20.69 MB at 20.69 MB/s Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7117d30-41b0-4e59-b6fe-7412cd9dafa3]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_wa3n1dvadevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:53 devstack sudo[109085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_mnhw13eidevstack@QuobyteHD Jun 28 14:35:53 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:53 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_wa3n1dvadevstack@QuobyteHD Jun 28 14:35:53 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:53 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_mnhw13eidevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2086348432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3153998-9061-427c-9bc4-25a6e83eee6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e78ff94e544ccc80babbf33c6491fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:51Z,use_quota=True,user_id='0d978b1bb7c34d03bf263a589d797d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Creating volume f3153998-9061-427c-9bc4-25a6e83eee6e {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:35:53 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:53 devstack sudo[109096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e 1073741824 Jun 28 14:35:53 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:53 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_wa3n1dvadevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Temporary image dfdfa247-b97d-4fd5-928f-a01fae72e0ac is fetched for user ebd19413ca804b2ba5097401350b6ec3. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c807b4-f726-4a9c-a9ae-f24032ad978a]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_wa3n1dvadevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:53 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_wa3n1dvadevstack@QuobyteHD Jun 28 14:35:53 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:54 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e 1073741824" returned: 0 in 0.858s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:54 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_wa3n1dvadevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:54 devstack sudo[109107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e Jun 28 14:35:54 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:55 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e" returned: 0 in 0.632s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.652s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1769115413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f01acb-c181-4bed-8a37-b65eeeb93390,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e9ebfd2d4954a038784af8fae9a88bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:35:52Z,use_quota=True,user_id='ebd19413ca804b2ba5097401350b6ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Creating volume a1f01acb-c181-4bed-8a37-b65eeeb93390 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:35:55 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:55 devstack sudo[109110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 1073741824 Jun 28 14:35:55 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Attempting download of dfdfa247-b97d-4fd5-928f-a01fae72e0ac ((None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}])) to volume f3153998-9061-427c-9bc4-25a6e83eee6e. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b853007-6cb0-4c52-88ee-884bdf80ad3b]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_yyj6popj {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:55 devstack sudo[109112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_yyj6popj Jun 28 14:35:55 devstack sudo[109112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:56 devstack sudo[109112]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_yyj6popj" returned: 0 in 0.756s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_yyj6popj {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:56 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 1073741824" returned: 0 in 0.852s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:56 devstack sudo[109120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 Jun 28 14:35:56 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:56 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_yyj6popj Jun 28 14:35:56 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:56 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390" returned: 0 in 0.675s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:35:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:35:56 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_yyj6popj" returned: 1 in 0.729s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_yyj6popj' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:35:56 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a349438-bddb-4c41-baa1-b2f0c8029b6b]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_mnhw13eidevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:56 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Attempting download of dfdfa247-b97d-4fd5-928f-a01fae72e0ac ((None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}])) to volume a1f01acb-c181-4bed-8a37-b65eeeb93390. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 28 14:35:56 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bcf99d-160e-4296-bdb0-32e5bc99bb35]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_1wyr03z3 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:56 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_mnhw13eidevstack@QuobyteHD Jun 28 14:35:56 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:57 devstack sudo[109127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_1wyr03z3 Jun 28 14:35:57 devstack sudo[109127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:57 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_mnhw13eidevstack@QuobyteHD" returned: 0 in 0.722s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:57 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] dfdfa247-b97d-4fd5-928f-a01fae72e0ac was qcow2, converting to raw {{(pid=93561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 28 14:35:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_mnhw13eidevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:57 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_mnhw13eidevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e Jun 28 14:35:57 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:57 devstack sudo[109127]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_1wyr03z3" returned: 0 in 0.746s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_1wyr03z3 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:57 devstack sudo[109137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_1wyr03z3 Jun 28 14:35:57 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:58 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_1wyr03z3" returned: 1 in 0.809s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_1wyr03z3' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:35:58 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c2d184-4ac6-4d63-b7f2-d002929eac5f]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:35:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_wa3n1dvadevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:58 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_wa3n1dvadevstack@QuobyteHD Jun 28 14:35:58 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:59 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_wa3n1dvadevstack@QuobyteHD" returned: 0 in 0.913s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:59 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] dfdfa247-b97d-4fd5-928f-a01fae72e0ac was qcow2, converting to raw {{(pid=93561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 28 14:35:59 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Jun 28 14:35:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_wa3n1dvadevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_mnhw13eidevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e" returned: 0 in 1.840s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:35:59 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_mnhw13eidevstack@QuobyteHD, size 112.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:35:59 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Converted 112.00 MB image at 60.78 MB/s Jun 28 14:35:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:35:59 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_wa3n1dvadevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 Jun 28 14:35:59 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:35:59 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e 1G Jun 28 14:35:59 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:00 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e 1G" returned: 0 in 0.707s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:00 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce3ee50-c533-4145-a0f5-08d2371bd1a4]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:36:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:00 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e Jun 28 14:36:00 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:01 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e" returned: 0 in 0.839s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:01 devstack sudo[109177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e Jun 28 14:36:01 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:01 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_wa3n1dvadevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390" returned: 0 in 1.818s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_wa3n1dvadevstack@QuobyteHD, size 112.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:36:01 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Converted 112.00 MB image at 61.58 MB/s Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:01 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 1G Jun 28 14:36:01 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:01 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e" returned: 1 in 0.758s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Downloaded image dfdfa247-b97d-4fd5-928f-a01fae72e0ac ((None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}])) to volume f3153998-9061-427c-9bc4-25a6e83eee6e successfully. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Temporary image dfdfa247-b97d-4fd5-928f-a01fae72e0ac for user 0d978b1bb7c34d03bf263a589d797d84 is deleted. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Marking volume f3153998-9061-427c-9bc4-25a6e83eee6e as bootable. {{(pid=93561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Copying metadata from image dfdfa247-b97d-4fd5-928f-a01fae72e0ac to f3153998-9061-427c-9bc4-25a6e83eee6e. {{(pid=93561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Creating volume glance metadata for volume f3153998-9061-427c-9bc4-25a6e83eee6e backed by image dfdfa247-b97d-4fd5-928f-a01fae72e0ac with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eab6430-87fa-427e-bd73-9d60b796d243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3153998-9061-427c-9bc4-25a6e83eee6e', 'volume_size': 1, 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e2aafa849d4b7590b8e84dddedb04b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'created_at': datetime.datetime(2026, 6, 28, 12, 14, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 14, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a309b8e-cbff-45a6-aa03-d9ec7e51b723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:01 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Volume volume-f3153998-9061-427c-9bc4-25a6e83eee6e (f3153998-9061-427c-9bc4-25a6e83eee6e): created successfully Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a309b8e-cbff-45a6-aa03-d9ec7e51b723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Flow 'volume_create_manager' (f4cdc839-574c-4cba-a8ac-448b1350092f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:36:01 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-01886cfb-efd9-4863-a30a-4ed9c23bdef8 tempest-VolumesImageMetadata-2115929414 None] Created volume successfully. Jun 28 14:36:01 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 1G" returned: 0 in 0.739s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:02 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a6c851-da9b-4434-bba7-33493caf0cb9]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:36:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:02 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 Jun 28 14:36:02 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:02 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390" returned: 0 in 0.737s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:02 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 Jun 28 14:36:02 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Acquiring lock "cinder-f3153998-9061-427c-9bc4-25a6e83eee6e-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Lock "cinder-f3153998-9061-427c-9bc4-25a6e83eee6e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Acquiring lock "cinder-quobyte-f3153998-9061-427c-9bc4-25a6e83eee6e" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Lock "cinder-quobyte-f3153998-9061-427c-9bc4-25a6e83eee6e" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc49922a-c2d7-449b-b841-cf8e50f66967]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:03 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390" returned: 1 in 0.755s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Downloaded image dfdfa247-b97d-4fd5-928f-a01fae72e0ac ((None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}])) to volume a1f01acb-c181-4bed-8a37-b65eeeb93390 successfully. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Temporary image dfdfa247-b97d-4fd5-928f-a01fae72e0ac for user ebd19413ca804b2ba5097401350b6ec3 is deleted. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Marking volume a1f01acb-c181-4bed-8a37-b65eeeb93390 as bootable. {{(pid=93561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Copying metadata from image dfdfa247-b97d-4fd5-928f-a01fae72e0ac to a1f01acb-c181-4bed-8a37-b65eeeb93390. {{(pid=93561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Creating volume glance metadata for volume a1f01acb-c181-4bed-8a37-b65eeeb93390 backed by image dfdfa247-b97d-4fd5-928f-a01fae72e0ac with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 28 14:36:03 devstack sudo[109196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d117ae9e-0791-4046-83c2-48739edf46bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f01acb-c181-4bed-8a37-b65eeeb93390', 'volume_size': 1, 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e2aafa849d4b7590b8e84dddedb04b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'created_at': datetime.datetime(2026, 6, 28, 12, 14, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 14, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:03 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d575d6-e4a8-4279-88f8-6c5e2b2c8ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:03 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Volume volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 (a1f01acb-c181-4bed-8a37-b65eeeb93390): created successfully Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d575d6-e4a8-4279-88f8-6c5e2b2c8ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Flow 'volume_create_manager' (da639a23-4199-4a3d-886b-97018a666568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:36:03 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-81eee801-16db-41a9-ac57-46abeab91c78 tempest-VolumesGetTest-1977329399 None] Created volume successfully. Jun 28 14:36:04 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e" returned: 0 in 0.756s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:04 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e Jun 28 14:36:04 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Flow 'volume_create_manager' (d66c28d1-cf6a-4702-b318-cf835d6f7fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c4b786-b0eb-4f20-8d13-238317c3e1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c4b786-b0eb-4f20-8d13-238317c3e1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:36:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1291810393',display_name='tempest-VolumesGetTest-Volume-1749365304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf3ced2-340d-4d20-ab2f-91249ff40e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e9ebfd2d4954a038784af8fae9a88bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:36:05Z,use_quota=True,user_id='ebd19413ca804b2ba5097401350b6ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a72650-d111-4135-bf4b-1d3614259924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a72650-d111-4135-bf4b-1d3614259924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f18b1d-3eae-48d6-98f6-b7048486151c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f18b1d-3eae-48d6-98f6-b7048486151c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf3ced2-340d-4d20-ab2f-91249ff40e26', 'volume_name': 'volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e8c8f8-8a85-4b05-8ece-e7ba10d3bd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e8c8f8-8a85-4b05-8ece-e7ba10d3bd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b0d13f-f426-4605-a11d-888341dda83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:04 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Volume ebf3ced2-340d-4d20-ab2f-91249ff40e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26', 'volume_size': 1} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:36:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1291810393',display_name='tempest-VolumesGetTest-Volume-1749365304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf3ced2-340d-4d20-ab2f-91249ff40e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e9ebfd2d4954a038784af8fae9a88bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:36:05Z,use_quota=True,user_id='ebd19413ca804b2ba5097401350b6ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Creating volume ebf3ced2-340d-4d20-ab2f-91249ff40e26 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:36:04 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:36:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:04 devstack sudo[109202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26 1073741824 Jun 28 14:36:04 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:05 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e" returned: 1 in 0.789s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:36:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:05 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e Jun 28 14:36:05 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:05 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26 1073741824" returned: 0 in 0.835s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:05 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f3153998-9061-427c-9bc4-25a6e83eee6e" returned: 0 in 0.674s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:05 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26 Jun 28 14:36:05 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Lock "cinder-quobyte-f3153998-9061-427c-9bc4-25a6e83eee6e" released by "delete_volume" :: held 2.285s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:05 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Created reservations ['31ada302-fac1-4143-a51b-c17ee42ed55a', '0ef78075-e998-4f3b-9bbb-bc27cbab05c9', '22f647b8-12f2-4bbd-9be4-7e912298f3f2', 'edc0690c-4863-4190-9a75-bec3add95830'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:36:05 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=97,cinder:INSERT=37,cinder:UPDATE=118,cinder:DELETE=9 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:36:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:05 devstack sudo[109216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:36:05 devstack sudo[109216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:06 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26" returned: 0 in 0.648s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:36:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b0d13f-f426-4605-a11d-888341dda83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fd1ec5-1fdb-41ec-9363-1cf741d41102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:06 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Volume volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26 (ebf3ced2-340d-4d20-ab2f-91249ff40e26): created successfully Jun 28 14:36:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fd1ec5-1fdb-41ec-9363-1cf741d41102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Flow 'volume_create_manager' (d66c28d1-cf6a-4702-b318-cf835d6f7fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:36:06 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-febb54d8-2f6c-4fef-930e-b5ab12b32418 tempest-VolumesGetTest-1977329399 None] Created volume successfully. Jun 28 14:36:06 devstack sudo[109216]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.650s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:06 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:36:06 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Deleted volume successfully. Jun 28 14:36:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b8f9db72-e98c-4e90-9daf-43676a9abd2b tempest-VolumesImageMetadata-2115929414 None] Lock "cinder-f3153998-9061-427c-9bc4-25a6e83eee6e-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-ebf3ced2-340d-4d20-ab2f-91249ff40e26-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Lock "cinder-ebf3ced2-340d-4d20-ab2f-91249ff40e26-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-quobyte-ebf3ced2-340d-4d20-ab2f-91249ff40e26" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:06 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-ebf3ced2-340d-4d20-ab2f-91249ff40e26" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:07 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b577a6-1195-41ec-be41-5c2a77cb7de6]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:36:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:07 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26 Jun 28 14:36:07 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:07 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26" returned: 0 in 0.817s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:07 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26 Jun 28 14:36:07 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:08 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ebf3ced2-340d-4d20-ab2f-91249ff40e26" returned: 0 in 0.699s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:08 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-ebf3ced2-340d-4d20-ab2f-91249ff40e26" released by "delete_volume" :: held 1.558s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:08 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Created reservations ['9200dde5-be99-470e-ac1d-fe639bafb696', 'fb5e4e0a-ecd7-4d24-a52e-9e978a7f2925', '6b338f04-e9ef-4bee-baf4-5decbfc3ecf0', 'aba00f89-0b8a-4ea3-8d31-835eff7b28b1'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:36:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:08 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:36:08 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-a1f01acb-c181-4bed-8a37-b65eeeb93390-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Lock "cinder-a1f01acb-c181-4bed-8a37-b65eeeb93390-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Acquiring lock "cinder-quobyte-a1f01acb-c181-4bed-8a37-b65eeeb93390" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-a1f01acb-c181-4bed-8a37-b65eeeb93390" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:09 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.688s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8178547f-c2b3-4be3-945e-509a46e7a885]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:36:09 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Deleted volume successfully. Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-62e9bb40-9e30-42ae-a85f-e43c013827ac tempest-VolumesGetTest-1977329399 None] Lock "cinder-ebf3ced2-340d-4d20-ab2f-91249ff40e26-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:09 devstack sudo[109233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 Jun 28 14:36:09 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Flow 'volume_create_manager' (b1783f13-a398-4024-b97f-b3a2e0d647e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bc8d07-99b5-444b-be4c-47a68c7e1874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bc8d07-99b5-444b-be4c-47a68c7e1874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1567063890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c0300f71f94878b2b7986dbf33f703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:36:10Z,use_quota=True,user_id='bcc04f804f8b40178abd0b866e648e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd52ca3f-e643-49b2-8021-3e31e1fde3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd52ca3f-e643-49b2-8021-3e31e1fde3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3aad29a-5316-4560-b683-87ea8218b6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3aad29a-5316-4560-b683-87ea8218b6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46', 'volume_name': 'volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd7334f-074d-4f96-98dd-129e86fd1d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd7334f-074d-4f96-98dd-129e86fd1d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd9c075-b38c-466f-9dbe-fd911bc1a12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:09 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Volume 8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46', 'volume_size': 1} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1567063890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c0300f71f94878b2b7986dbf33f703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:36:10Z,use_quota=True,user_id='bcc04f804f8b40178abd0b866e648e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Creating volume 8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:36:09 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:36:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:09 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 1073741824 Jun 28 14:36:09 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:10 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390" returned: 0 in 0.790s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:10 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 Jun 28 14:36:10 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:10 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 1073741824" returned: 0 in 0.838s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:10 devstack sudo[109246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 Jun 28 14:36:10 devstack sudo[109246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:10 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390" returned: 1 in 0.765s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:36:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:10 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390 Jun 28 14:36:10 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:11 devstack sudo[109246]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46" returned: 0 in 0.652s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd9c075-b38c-466f-9dbe-fd911bc1a12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb551d3-f98e-41b8-a9a5-0deaf7a60915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:11 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Volume volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 (8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46): created successfully Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb551d3-f98e-41b8-a9a5-0deaf7a60915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Flow 'volume_create_manager' (b1783f13-a398-4024-b97f-b3a2e0d647e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:36:11 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-19e10010-05d9-4b0b-85bb-15dacd62f099 tempest-SnapshotMetadataTestJSON-404502608 None] Created volume successfully. Jun 28 14:36:11 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1f01acb-c181-4bed-8a37-b65eeeb93390" returned: 0 in 0.659s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Lock "cinder-quobyte-a1f01acb-c181-4bed-8a37-b65eeeb93390" released by "delete_volume" :: held 2.297s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Created reservations ['fffc211e-700e-4f0e-b7a9-e5cf7f4c2dcb', '7aeba27a-03d5-4f03-a035-977233621f22', '58a13d7a-f289-4470-86be-5a20354208d7', '3ef59099-eae0-4e1d-8add-043d0e78a848'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:11 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:36:11 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] Creating offline snapshot bdee6643-ce3d-4a44-8bea-01d3099a2e30 of volume 8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b5d63b-de45-4392-a6c6-f9d6df0464e4]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:36:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:11 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 Jun 28 14:36:11 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:12 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.686s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:12 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:36:12 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Deleted volume successfully. Jun 28 14:36:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f1edaffa-76a6-4ad5-a234-99d77758c140 tempest-VolumesGetTest-1977329399 None] Lock "cinder-a1f01acb-c181-4bed-8a37-b65eeeb93390-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:12 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46" returned: 0 in 0.779s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:12 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30 1G Jun 28 14:36:12 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:13 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30 1G" returned: 0 in 0.884s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:13 devstack sudo[109268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30 Jun 28 14:36:13 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:14 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30" returned: 0 in 0.735s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:14 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30 is being set with open permissions: ugo+rw Jun 28 14:36:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:14 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30 Jun 28 14:36:14 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:14 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30" returned: 0 in 0.646s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:15 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.info Jun 28 14:36:15 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:15 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:36:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Flow 'volume_create_manager' (33808e0e-fc50-4498-ae4f-4764ed088588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:36:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8196a1-5708-4894-a587-8fdf37b3ba73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8196a1-5708-4894-a587-8fdf37b3ba73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-236380615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33813eb3-4e47-48c4-85c0-0b9627b58c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3881516bac7464694e2a4415b3e1ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:36:15Z,use_quota=True,user_id='fc1dd8f80e9c497ca04cbcb36f9d3b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f694299-d276-4940-8200-bd8f38796ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f694299-d276-4940-8200-bd8f38796ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd0b744-1038-49d9-93db-aa994184c9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd0b744-1038-49d9-93db-aa994184c9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33813eb3-4e47-48c4-85c0-0b9627b58c2c', 'volume_name': 'volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c0a531-6a69-465c-b0b2-8e37cba21e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c0a531-6a69-465c-b0b2-8e37cba21e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:15 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0882ba12-1a55-4f16-acbc-a974f9af46fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:15 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Volume 33813eb3-4e47-48c4-85c0-0b9627b58c2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c', 'volume_size': 1} Jun 28 14:36:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:15 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.info" returned: 0 in 0.659s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:15 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.info is being set with open permissions: ugo+rw Jun 28 14:36:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:15 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.info Jun 28 14:36:15 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:16 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.info" returned: 0 in 0.631s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.430s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-236380615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33813eb3-4e47-48c4-85c0-0b9627b58c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3881516bac7464694e2a4415b3e1ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:36:15Z,use_quota=True,user_id='fc1dd8f80e9c497ca04cbcb36f9d3b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:36:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Creating volume 33813eb3-4e47-48c4-85c0-0b9627b58c2c {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:36:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:36:16 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:36:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:16 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c 1073741824 Jun 28 14:36:16 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:16 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-1e525adc-4a0c-43d5-adf3-b2fdbf2822f0 tempest-SnapshotMetadataTestJSON-404502608 None] Create snapshot completed successfully Jun 28 14:36:17 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c 1073741824" returned: 0 in 0.828s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:17 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c Jun 28 14:36:17 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Acquiring lock "cinder-bdee6643-ce3d-4a44-8bea-01d3099a2e30-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Lock "cinder-bdee6643-ce3d-4a44-8bea-01d3099a2e30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Acquiring lock "cinder-quobyte-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Lock "cinder-quobyte-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Acquiring lock "cinder-quobyte-bdee6643-ce3d-4a44-8bea-01d3099a2e30" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:17 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c" returned: 0 in 0.652s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Lock "cinder-quobyte-bdee6643-ce3d-4a44-8bea-01d3099a2e30" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Deleting offline snapshot bdee6643-ce3d-4a44-8bea-01d3099a2e30 of volume 8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] snapshot_file for this snap is: volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf9cd5f-a152-48b6-b233-f933a07577fa]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0882ba12-1a55-4f16-acbc-a974f9af46fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a05266-3297-4148-bd7a-d5d1c9824246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:17 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Volume volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c (33813eb3-4e47-48c4-85c0-0b9627b58c2c): created successfully Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a05266-3297-4148-bd7a-d5d1c9824246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Flow 'volume_create_manager' (33808e0e-fc50-4498-ae4f-4764ed088588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:36:17 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-b21accf4-5c68-4a27-bdb5-95f790080b20 tempest-VolumesNegativeTest-1675117958 None] Created volume successfully. Jun 28 14:36:17 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30 Jun 28 14:36:17 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:18 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30" returned: 0 in 0.764s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:36:18 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d74c56-2a3f-416a-8d7f-b1ebc689946c]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:36:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:18 devstack sudo[109297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 Jun 28 14:36:18 devstack sudo[109297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:19 devstack sudo[109297]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46" returned: 0 in 0.812s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:19 devstack sudo[109307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30 Jun 28 14:36:19 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:20 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30" returned: 0 in 0.772s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:20 devstack sudo[109313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30 Jun 28 14:36:20 devstack sudo[109313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:20 devstack sudo[109313]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46.bdee6643-ce3d-4a44-8bea-01d3099a2e30" returned: 0 in 0.667s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Lock "cinder-quobyte-bdee6643-ce3d-4a44-8bea-01d3099a2e30" released by "_delete_snapshot" :: held 3.119s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:20 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Lock "cinder-quobyte-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46" released by "delete_snapshot" :: held 3.142s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:20 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Created reservations ['49076c55-4d78-4336-ac2d-b1d0b94b33ee', '06b504c1-fc75-4829-8407-d749c6fce6e2', '6cb9bbc3-ce97-4b4a-bca1-31a5441782bf', '198b4d60-2c0d-4351-af20-483049b78a39'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:36:21 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Delete snapshot completed successfully. Jun 28 14:36:21 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8ade3ad9-ae75-402c-ae74-605eaa2b2fa5 tempest-SnapshotMetadataTestJSON-404502608 None] Lock "cinder-bdee6643-ce3d-4a44-8bea-01d3099a2e30-delete_snapshot" released by "delete_snapshot" :: held 3.292s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Acquiring lock "cinder-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Lock "cinder-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Acquiring lock "cinder-quobyte-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Lock "cinder-quobyte-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46" acquired by "delete_volume" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:22 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[325e37ea-ffbb-4138-85f1-36a6b34a7661]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:36:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:22 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 Jun 28 14:36:22 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:22 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46" returned: 0 in 0.751s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:22 devstack sudo[109327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46 Jun 28 14:36:22 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:23 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46" returned: 0 in 0.639s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:23 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Lock "cinder-quobyte-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46" released by "delete_volume" :: held 1.454s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:23 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Created reservations ['3186b3b0-2e9f-40ab-b6f9-e1deec80171f', '02ee8d93-0062-4134-878e-dca9be786573', 'b87d4577-9022-493c-9eb5-b8007703f035', '9e7e28da-95d7-4d91-aac2-48675c958626'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:36:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:23 devstack sudo[109330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:36:23 devstack sudo[109330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:24 devstack sudo[109330]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.709s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:24 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:36:24 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Deleted volume successfully. Jun 28 14:36:24 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-96299c81-d61d-4757-ba7b-1ca0a25c03db tempest-SnapshotMetadataTestJSON-404502608 None] Lock "cinder-8f2e62f2-fa3b-4b63-86ac-aa8a82d98e46-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Flow 'volume_create_manager' (bf32b210-8e8a-49fd-9524-7cbcbd24b6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76085ab1-704b-4df9-a428-17db9bd878f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76085ab1-704b-4df9-a428-17db9bd878f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1385617905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ee024c-375a-4bbd-ac29-19df3f457626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c054694ce494a55ad104c3f5f3f08ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:36:29Z,use_quota=True,user_id='c933b426b59b4c4a98416a39f44426c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2f0f2e-5a45-47b9-afb4-6e0481aef430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2f0f2e-5a45-47b9-afb4-6e0481aef430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4388ed-e43c-428d-be67-eb660fc161b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4388ed-e43c-428d-be67-eb660fc161b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ee024c-375a-4bbd-ac29-19df3f457626', 'volume_name': 'volume-b3ee024c-375a-4bbd-ac29-19df3f457626', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f3fb9d-b27c-4b24-aab2-73c974c9afcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f3fb9d-b27c-4b24-aab2-73c974c9afcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc147c45-b365-4f29-a8a2-0f66cf20415a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:28 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Volume b3ee024c-375a-4bbd-ac29-19df3f457626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ee024c-375a-4bbd-ac29-19df3f457626', 'volume_size': 1} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1385617905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ee024c-375a-4bbd-ac29-19df3f457626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c054694ce494a55ad104c3f5f3f08ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:36:29Z,use_quota=True,user_id='c933b426b59b4c4a98416a39f44426c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Creating volume b3ee024c-375a-4bbd-ac29-19df3f457626 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:36:28 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:36:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3ee024c-375a-4bbd-ac29-19df3f457626 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:28 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3ee024c-375a-4bbd-ac29-19df3f457626 1073741824 Jun 28 14:36:28 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:29 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3ee024c-375a-4bbd-ac29-19df3f457626 1073741824" returned: 0 in 0.832s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3ee024c-375a-4bbd-ac29-19df3f457626 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:29 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3ee024c-375a-4bbd-ac29-19df3f457626 Jun 28 14:36:29 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:30 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3ee024c-375a-4bbd-ac29-19df3f457626" returned: 0 in 0.641s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:36:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc147c45-b365-4f29-a8a2-0f66cf20415a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ee024c-375a-4bbd-ac29-19df3f457626', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b148489f-e346-4327-8903-f3329e71d0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:30 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Volume volume-b3ee024c-375a-4bbd-ac29-19df3f457626 (b3ee024c-375a-4bbd-ac29-19df3f457626): created successfully Jun 28 14:36:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b148489f-e346-4327-8903-f3329e71d0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Flow 'volume_create_manager' (bf32b210-8e8a-49fd-9524-7cbcbd24b6fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:36:30 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c9e93137-73f8-4044-bb6b-477cb69a75f0 tempest-AbsoluteLimitsTests-2144172546 None] Created volume successfully. Jun 28 14:36:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Acquiring lock "cinder-b3ee024c-375a-4bbd-ac29-19df3f457626-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Lock "cinder-b3ee024c-375a-4bbd-ac29-19df3f457626-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Acquiring lock "cinder-quobyte-b3ee024c-375a-4bbd-ac29-19df3f457626" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Lock "cinder-quobyte-b3ee024c-375a-4bbd-ac29-19df3f457626" acquired by "delete_volume" :: waited 0.013s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:30 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc14860-8737-4623-bd4a-224dcca917c8]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:36:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3ee024c-375a-4bbd-ac29-19df3f457626 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:30 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3ee024c-375a-4bbd-ac29-19df3f457626 Jun 28 14:36:30 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:31 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3ee024c-375a-4bbd-ac29-19df3f457626" returned: 0 in 0.765s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3ee024c-375a-4bbd-ac29-19df3f457626 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:31 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3ee024c-375a-4bbd-ac29-19df3f457626 Jun 28 14:36:31 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:32 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3ee024c-375a-4bbd-ac29-19df3f457626" returned: 0 in 1.016s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Lock "cinder-quobyte-b3ee024c-375a-4bbd-ac29-19df3f457626" released by "delete_volume" :: held 1.829s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:32 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Created reservations ['ec87ccaf-635d-4617-92fb-db6ebc73cd12', '86d706bb-0bbe-4634-8dfb-64c38777516a', '150bebd8-4a83-4e4e-9b36-2fad22089694', '4b798206-e9e6-40d6-af48-91e86d99aedc'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:36:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:32 devstack sudo[109447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:36:32 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:33 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.753s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:33 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:36:33 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Deleted volume successfully. Jun 28 14:36:33 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-47099b5a-8495-4a02-a0b9-d13df039bfd4 tempest-AbsoluteLimitsTests-2144172546 None] Lock "cinder-b3ee024c-375a-4bbd-ac29-19df3f457626-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:36:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:37 devstack sudo[109496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:36:37 devstack sudo[109496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:38 devstack sudo[109496]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.716s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:36:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:36:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 28 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:36:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Flow 'volume_create_manager' (a2071a72-a7fe-4e05-be15-5d4b8433bd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02eae82f-29ce-4db3-aa8d-e8f0617df9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02eae82f-29ce-4db3-aa8d-e8f0617df9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-40135954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a3236b-bcac-459e-a324-d3383af18fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='499a792a0fd34fe79100a6455618eb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:36:39Z,use_quota=True,user_id='d8a36080f1f7414ea2bc58f1982bb2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d19add-fdb0-4132-8a6c-fa6e5fe7ed0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d19add-fdb0-4132-8a6c-fa6e5fe7ed0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ee0fea-5ca4-405d-9078-1b1b25f4b9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ee0fea-5ca4-405d-9078-1b1b25f4b9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a3236b-bcac-459e-a324-d3383af18fb7', 'volume_name': 'volume-08a3236b-bcac-459e-a324-d3383af18fb7', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fcc8ec-b929-4ceb-b275-2367fd461a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fcc8ec-b929-4ceb-b275-2367fd461a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b86c8bc-1a57-4e59-8e68-6380941fd9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:39 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Volume 08a3236b-bcac-459e-a324-d3383af18fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a3236b-bcac-459e-a324-d3383af18fb7', 'volume_size': 1} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-40135954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a3236b-bcac-459e-a324-d3383af18fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='499a792a0fd34fe79100a6455618eb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:36:39Z,use_quota=True,user_id='d8a36080f1f7414ea2bc58f1982bb2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Creating volume 08a3236b-bcac-459e-a324-d3383af18fb7 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:36:39 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:36:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08a3236b-bcac-459e-a324-d3383af18fb7 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:39 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08a3236b-bcac-459e-a324-d3383af18fb7 1073741824 Jun 28 14:36:39 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:40 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08a3236b-bcac-459e-a324-d3383af18fb7 1073741824" returned: 0 in 0.818s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:40 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:UPDATE=121,cinder:SELECT=79,cinder:DELETE=12,cinder:INSERT=37 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:36:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08a3236b-bcac-459e-a324-d3383af18fb7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:40 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08a3236b-bcac-459e-a324-d3383af18fb7 Jun 28 14:36:40 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:40 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08a3236b-bcac-459e-a324-d3383af18fb7" returned: 0 in 0.640s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:36:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b86c8bc-1a57-4e59-8e68-6380941fd9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a3236b-bcac-459e-a324-d3383af18fb7', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d99e40f-d4da-4a44-bfbe-253c3ba73d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:40 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Volume volume-08a3236b-bcac-459e-a324-d3383af18fb7 (08a3236b-bcac-459e-a324-d3383af18fb7): created successfully Jun 28 14:36:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d99e40f-d4da-4a44-bfbe-253c3ba73d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:40 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Flow 'volume_create_manager' (a2071a72-a7fe-4e05-be15-5d4b8433bd24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:36:40 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a9607713-8a16-4bec-ab8d-16766afd605d tempest-VolumesTransfersV357Test-956586949 None] Created volume successfully. Jun 28 14:36:41 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-cb0dc6f5-ea7b-4c0c-b018-a8a1d364079a tempest-VolumesTransfersV357Test-1133126812 None] Transfer volume completed successfully. Jun 28 14:36:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Acquiring lock "cinder-08a3236b-bcac-459e-a324-d3383af18fb7-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Lock "cinder-08a3236b-bcac-459e-a324-d3383af18fb7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Acquiring lock "cinder-quobyte-08a3236b-bcac-459e-a324-d3383af18fb7" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Lock "cinder-quobyte-08a3236b-bcac-459e-a324-d3383af18fb7" acquired by "delete_volume" :: waited 0.012s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:42 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1ac18b-4867-451f-b7e2-7134111fc129]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:36:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08a3236b-bcac-459e-a324-d3383af18fb7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:42 devstack sudo[109547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08a3236b-bcac-459e-a324-d3383af18fb7 Jun 28 14:36:42 devstack sudo[109547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:43 devstack sudo[109547]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08a3236b-bcac-459e-a324-d3383af18fb7" returned: 0 in 0.804s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08a3236b-bcac-459e-a324-d3383af18fb7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:43 devstack sudo[109553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08a3236b-bcac-459e-a324-d3383af18fb7 Jun 28 14:36:43 devstack sudo[109553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:44 devstack sudo[109553]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-08a3236b-bcac-459e-a324-d3383af18fb7" returned: 0 in 0.642s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Lock "cinder-quobyte-08a3236b-bcac-459e-a324-d3383af18fb7" released by "delete_volume" :: held 1.489s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:44 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Created reservations ['5404f0d4-9440-448d-9701-3e65ca63099c', '059bba74-826f-4170-a0cb-592ac98af651', 'c2e42823-9cf4-446a-91a0-859151d2f162', '4df879e7-5b58-45b5-93f2-92cb5e3c621a'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:36:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:44 devstack sudo[109556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:36:44 devstack sudo[109556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:44 devstack sudo[109556]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.673s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:44 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:36:45 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Deleted volume successfully. Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d7a506f8-9110-4093-a939-dfff687d25bf tempest-VolumesTransfersV357Test-1428682735 None] Lock "cinder-08a3236b-bcac-459e-a324-d3383af18fb7-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Flow 'volume_create_manager' (7bbe4e4b-7080-4dc8-a0eb-fb91470f4482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec8b570-aeb1-49a2-b03e-24091102602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec8b570-aeb1-49a2-b03e-24091102602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1717680244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d3aa86-6905-4ce8-a7eb-7336e40fbb37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='499a792a0fd34fe79100a6455618eb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:36:45Z,use_quota=True,user_id='d8a36080f1f7414ea2bc58f1982bb2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2859e72e-8d45-4aa5-ba17-6114cb14881c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2859e72e-8d45-4aa5-ba17-6114cb14881c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45799d2-4e80-47ac-9e43-8e23deddc845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45799d2-4e80-47ac-9e43-8e23deddc845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6d3aa86-6905-4ce8-a7eb-7336e40fbb37', 'volume_name': 'volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c61985-9bec-4795-a699-cf6e8a8cda59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c61985-9bec-4795-a699-cf6e8a8cda59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874094da-9cad-47c7-8096-042ed4f10da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:45 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Volume b6d3aa86-6905-4ce8-a7eb-7336e40fbb37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37', 'volume_size': 1} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1717680244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d3aa86-6905-4ce8-a7eb-7336e40fbb37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='499a792a0fd34fe79100a6455618eb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:36:45Z,use_quota=True,user_id='d8a36080f1f7414ea2bc58f1982bb2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Creating volume b6d3aa86-6905-4ce8-a7eb-7336e40fbb37 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:36:45 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:36:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:45 devstack sudo[109561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37 1073741824 Jun 28 14:36:45 devstack sudo[109561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:46 devstack sudo[109561]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37 1073741824" returned: 0 in 0.835s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:46 devstack sudo[109567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37 Jun 28 14:36:46 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:47 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37" returned: 0 in 0.638s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:36:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874094da-9cad-47c7-8096-042ed4f10da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c874df-75e6-44c2-b9ca-f82799e389cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:47 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Volume volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37 (b6d3aa86-6905-4ce8-a7eb-7336e40fbb37): created successfully Jun 28 14:36:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c874df-75e6-44c2-b9ca-f82799e389cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Flow 'volume_create_manager' (7bbe4e4b-7080-4dc8-a0eb-fb91470f4482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:36:47 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-b2828488-c7b1-436b-9399-3be4da6e2521 tempest-VolumesTransfersV357Test-956586949 None] Created volume successfully. Jun 28 14:36:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Acquiring lock "cinder-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Lock "cinder-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Acquiring lock "cinder-quobyte-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Lock "cinder-quobyte-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37" acquired by "delete_volume" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:47 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7589ee55-720f-44df-b7b6-f5307532d250]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:36:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:47 devstack sudo[109570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37 Jun 28 14:36:47 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Acquiring lock "cinder-33813eb3-4e47-48c4-85c0-0b9627b58c2c-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Lock "cinder-33813eb3-4e47-48c4-85c0-0b9627b58c2c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:48 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37" returned: 0 in 0.794s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:48 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37 Jun 28 14:36:48 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Acquiring lock "cinder-quobyte-33813eb3-4e47-48c4-85c0-0b9627b58c2c" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:36:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Lock "cinder-quobyte-33813eb3-4e47-48c4-85c0-0b9627b58c2c" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:36:48 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da2d8fe-d785-4359-8112-9d087ec65c95]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:36:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:48 devstack sudo[109577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c Jun 28 14:36:48 devstack sudo[109577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:49 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37" returned: 0 in 0.657s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Lock "cinder-quobyte-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37" released by "delete_volume" :: held 1.498s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:49 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Created reservations ['b98497f0-2c83-44b6-b09a-5a2af283f4de', 'eb1a797f-3e62-4b38-bb7d-5f885ef5400f', 'b0c5d072-56ee-4ae5-9cd6-def1ee29a473', '179c595c-eb79-484b-adab-5f223d4aca95'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:36:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:49 devstack sudo[109583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:36:49 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:49 devstack sudo[109577]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c" returned: 0 in 0.777s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:49 devstack sudo[109585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c Jun 28 14:36:49 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:50 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.679s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:50 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:36:50 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Deleted volume successfully. Jun 28 14:36:50 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33813eb3-4e47-48c4-85c0-0b9627b58c2c" returned: 0 in 0.633s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d5b62300-2f7d-4937-a0ee-a3c616b15aaf tempest-VolumesTransfersV357Test-1428682735 None] Lock "cinder-b6d3aa86-6905-4ce8-a7eb-7336e40fbb37-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Lock "cinder-quobyte-33813eb3-4e47-48c4-85c0-0b9627b58c2c" released by "delete_volume" :: held 1.459s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:50 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Created reservations ['5b17260e-07f9-4bc0-918c-f296b8ccdc59', 'e0f7cd37-ce59-4131-bfe3-a3b05fa778cb', '0641ff24-a500-45e4-b2fd-5ffbd0c94c2a', 'd52f61fe-86f1-449f-9f3d-147ba1d6f9dc'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:36:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:50 devstack sudo[109590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:36:50 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:50 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.657s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:50 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:36:50 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Deleted volume successfully. Jun 28 14:36:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b3cce579-2147-444a-b5a5-37c4a319313c tempest-VolumesNegativeTest-1675117958 None] Lock "cinder-33813eb3-4e47-48c4-85c0-0b9627b58c2c-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Flow 'volume_create_manager' (187dc452-53d8-4573-8cf6-a75bae54bc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9faf1e26-218b-4adf-ad82-7c0a1864952d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9faf1e26-218b-4adf-ad82-7c0a1864952d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1150050428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d31284-f098-4145-9879-5f605448812d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7acba5a4bb00427988dbff6c22e1b8ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:36:58Z,use_quota=True,user_id='ca847b03c42a44b88102a4cdc726dcef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d27bc2-bc02-4881-92e6-70080d60f306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d27bc2-bc02-4881-92e6-70080d60f306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539c7427-7bdc-4029-adce-9f45cf945375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539c7427-7bdc-4029-adce-9f45cf945375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d31284-f098-4145-9879-5f605448812d', 'volume_name': 'volume-38d31284-f098-4145-9879-5f605448812d', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92996100-fc14-4ae6-99de-13df0f27f337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92996100-fc14-4ae6-99de-13df0f27f337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509f1fc5-429e-41a6-a229-3f3e23ffc7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:36:58 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Volume 38d31284-f098-4145-9879-5f605448812d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d31284-f098-4145-9879-5f605448812d', 'volume_size': 1} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1150050428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d31284-f098-4145-9879-5f605448812d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7acba5a4bb00427988dbff6c22e1b8ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:36:58Z,use_quota=True,user_id='ca847b03c42a44b88102a4cdc726dcef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Creating volume 38d31284-f098-4145-9879-5f605448812d {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:36:58 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:36:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-38d31284-f098-4145-9879-5f605448812d 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:58 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-38d31284-f098-4145-9879-5f605448812d 1073741824 Jun 28 14:36:58 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:36:59 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Jun 28 14:36:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-38d31284-f098-4145-9879-5f605448812d 1073741824" returned: 0 in 0.833s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:36:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-38d31284-f098-4145-9879-5f605448812d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:36:59 devstack sudo[109599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-38d31284-f098-4145-9879-5f605448812d Jun 28 14:36:59 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-38d31284-f098-4145-9879-5f605448812d" returned: 0 in 0.706s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:00 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:37:00 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509f1fc5-429e-41a6-a229-3f3e23ffc7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d31284-f098-4145-9879-5f605448812d', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02240fff-c2ad-4a80-ac4a-de92d8d881d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:00 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Volume volume-38d31284-f098-4145-9879-5f605448812d (38d31284-f098-4145-9879-5f605448812d): created successfully Jun 28 14:37:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02240fff-c2ad-4a80-ac4a-de92d8d881d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:00 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Flow 'volume_create_manager' (187dc452-53d8-4573-8cf6-a75bae54bc44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:00 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-fdec5dda-a62a-4d68-8068-fbcfe3e3afe8 tempest-VolumesListTestJSON-275563959 None] Created volume successfully. Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Flow 'volume_create_manager' (37fd25b4-1492-4e52-88b0-84613c1d3ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58092713-c3b3-45d1-ac9d-587245f9c9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58092713-c3b3-45d1-ac9d-587245f9c9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1988789106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7acba5a4bb00427988dbff6c22e1b8ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:37:01Z,use_quota=True,user_id='ca847b03c42a44b88102a4cdc726dcef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb57dc4-7e42-46e3-b774-340b367d1779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb57dc4-7e42-46e3-b774-340b367d1779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1fbc9d-3368-477e-bd75-f4a5b677ca15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1fbc9d-3368-477e-bd75-f4a5b677ca15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67', 'volume_name': 'volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65820220-6d03-4014-88a4-3c2236e6e125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65820220-6d03-4014-88a4-3c2236e6e125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa752747-8aa7-4f95-9a22-2a98769d3a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:01 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Volume 2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67', 'volume_size': 1} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1988789106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7acba5a4bb00427988dbff6c22e1b8ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:37:01Z,use_quota=True,user_id='ca847b03c42a44b88102a4cdc726dcef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Creating volume 2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:37:01 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:37:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:01 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67 1073741824 Jun 28 14:37:01 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:02 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67 1073741824" returned: 0 in 0.963s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:02 devstack sudo[109609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67 Jun 28 14:37:02 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:02 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67" returned: 0 in 0.759s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:02 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:37:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa752747-8aa7-4f95-9a22-2a98769d3a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7216b650-d458-4193-8cd4-60affa0e5b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:02 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Volume volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67 (2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67): created successfully Jun 28 14:37:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7216b650-d458-4193-8cd4-60affa0e5b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:02 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Flow 'volume_create_manager' (37fd25b4-1492-4e52-88b0-84613c1d3ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:02 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-28199dd0-82f6-4a75-a8a1-6c4a7f900cfa tempest-VolumesListTestJSON-275563959 None] Created volume successfully. Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Flow 'volume_create_manager' (207472b9-49f5-44a3-8916-0ddc3c79e47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce93dfd-2784-4c3d-8472-6652740c8c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce93dfd-2784-4c3d-8472-6652740c8c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-246409612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46582a85-41e1-47d3-bcb5-914968a9eb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fb5f6268bc45f6825a530faa32637f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:37:03Z,use_quota=True,user_id='8cd58d6a2013458f86348d48f850a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886d5fca-c13b-42a6-90aa-d0624c52475e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886d5fca-c13b-42a6-90aa-d0624c52475e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0e314d-4688-433b-9144-a8a6ad480579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0e314d-4688-433b-9144-a8a6ad480579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46582a85-41e1-47d3-bcb5-914968a9eb66', 'volume_name': 'volume-46582a85-41e1-47d3-bcb5-914968a9eb66', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e08d18-40e7-4368-97b1-76bb170ec7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e08d18-40e7-4368-97b1-76bb170ec7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff74c89-9caa-45f1-9d8f-6b3557145b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:03 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Volume 46582a85-41e1-47d3-bcb5-914968a9eb66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46582a85-41e1-47d3-bcb5-914968a9eb66', 'volume_size': 1} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-246409612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46582a85-41e1-47d3-bcb5-914968a9eb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fb5f6268bc45f6825a530faa32637f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:37:03Z,use_quota=True,user_id='8cd58d6a2013458f86348d48f850a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Creating volume 46582a85-41e1-47d3-bcb5-914968a9eb66 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:37:03 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:03 devstack sudo[109612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66 1073741824 Jun 28 14:37:03 devstack sudo[109612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Flow 'volume_create_manager' (29464ca5-1d5e-4047-9cb8-293faebc1fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2d63a9-05fa-4545-bf1e-caa5b7eb6b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2d63a9-05fa-4545-bf1e-caa5b7eb6b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2073705593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4c3b9e-55b7-419d-8543-38c735ae5cd6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7acba5a4bb00427988dbff6c22e1b8ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:37:04Z,use_quota=True,user_id='ca847b03c42a44b88102a4cdc726dcef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1066cf3-7c68-461f-9de0-ec1c72fcd638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1066cf3-7c68-461f-9de0-ec1c72fcd638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093c3d06-905e-4e78-84c7-df8692de597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093c3d06-905e-4e78-84c7-df8692de597d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e4c3b9e-55b7-419d-8543-38c735ae5cd6', 'volume_name': 'volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4444527c-62c1-4e23-96df-e9eb6d47b8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4444527c-62c1-4e23-96df-e9eb6d47b8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216a50f4-af2e-4a65-a7ce-7d5ac451c2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:03 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Volume 3e4c3b9e-55b7-419d-8543-38c735ae5cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6', 'volume_size': 1} Jun 28 14:37:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:04 devstack sudo[109612]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66 1073741824" returned: 0 in 0.839s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:04 devstack sudo[109618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66 Jun 28 14:37:04 devstack sudo[109618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:04 devstack sudo[109618]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66" returned: 0 in 0.632s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.147s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2073705593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4c3b9e-55b7-419d-8543-38c735ae5cd6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7acba5a4bb00427988dbff6c22e1b8ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:37:04Z,use_quota=True,user_id='ca847b03c42a44b88102a4cdc726dcef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Creating volume 3e4c3b9e-55b7-419d-8543-38c735ae5cd6 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:37:04 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:04 devstack sudo[109621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6 1073741824 Jun 28 14:37:04 devstack sudo[109621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff74c89-9caa-45f1-9d8f-6b3557145b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46582a85-41e1-47d3-bcb5-914968a9eb66', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de780b0-34ef-401b-bb64-d66d20db78eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:04 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Volume volume-46582a85-41e1-47d3-bcb5-914968a9eb66 (46582a85-41e1-47d3-bcb5-914968a9eb66): created successfully Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de780b0-34ef-401b-bb64-d66d20db78eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Flow 'volume_create_manager' (207472b9-49f5-44a3-8916-0ddc3c79e47d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:04 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-12db1823-466d-49f5-8e0c-abede2a55d0b tempest-VolumesSnapshotTestJSON-1711042781 None] Created volume successfully. Jun 28 14:37:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:05 devstack sudo[109621]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6 1073741824" returned: 0 in 0.849s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:05 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6 Jun 28 14:37:05 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:06 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6" returned: 0 in 0.623s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:37:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.820s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:06 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=70,cinder:UPDATE=92,cinder:DELETE=5,cinder:INSERT=25 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:37:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216a50f4-af2e-4a65-a7ce-7d5ac451c2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ba2ce7-e8cb-499d-a052-c7036961d355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] Creating offline snapshot 5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f of volume 46582a85-41e1-47d3-bcb5-914968a9eb66 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:37:06 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Volume volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6 (3e4c3b9e-55b7-419d-8543-38c735ae5cd6): created successfully Jun 28 14:37:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ba2ce7-e8cb-499d-a052-c7036961d355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Flow 'volume_create_manager' (29464ca5-1d5e-4047-9cb8-293faebc1fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:06 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a83d43e-c79f-4cca-a648-09f0bf9e87ce]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:06 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-972b0277-4856-4476-96cf-13d7db123323 tempest-VolumesListTestJSON-275563959 None] Created volume successfully. Jun 28 14:37:06 devstack sudo[109630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66 Jun 28 14:37:06 devstack sudo[109630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:07 devstack sudo[109630]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66" returned: 0 in 0.739s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:07 devstack sudo[109635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f 1G Jun 28 14:37:07 devstack sudo[109635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:08 devstack sudo[109635]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f 1G" returned: 0 in 0.786s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46582a85-41e1-47d3-bcb5-914968a9eb66 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:08 devstack sudo[109641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46582a85-41e1-47d3-bcb5-914968a9eb66 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f Jun 28 14:37:08 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:08 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46582a85-41e1-47d3-bcb5-914968a9eb66 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f" returned: 0 in 0.737s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:08 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f is being set with open permissions: ugo+rw Jun 28 14:37:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:08 devstack sudo[109647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f Jun 28 14:37:08 devstack sudo[109647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:08 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Acquiring lock "cinder-3e4c3b9e-55b7-419d-8543-38c735ae5cd6-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:08 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Lock "cinder-3e4c3b9e-55b7-419d-8543-38c735ae5cd6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:08 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Acquiring lock "cinder-quobyte-3e4c3b9e-55b7-419d-8543-38c735ae5cd6" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:08 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Lock "cinder-quobyte-3e4c3b9e-55b7-419d-8543-38c735ae5cd6" acquired by "delete_volume" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:08 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c041a5d-e868-4645-a3bb-86d22253b1c4]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:09 devstack sudo[109649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6 Jun 28 14:37:09 devstack sudo[109649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:09 devstack sudo[109647]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f" returned: 0 in 0.661s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:09 devstack sudo[109652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.info Jun 28 14:37:09 devstack sudo[109652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:09 devstack sudo[109649]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6" returned: 0 in 0.774s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:09 devstack sudo[109659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6 Jun 28 14:37:09 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:10 devstack sudo[109652]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.info" returned: 0 in 0.663s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:10 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.info is being set with open permissions: ugo+rw Jun 28 14:37:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:10 devstack sudo[109663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.info Jun 28 14:37:10 devstack sudo[109663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:10 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3e4c3b9e-55b7-419d-8543-38c735ae5cd6" returned: 0 in 0.640s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:10 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Lock "cinder-quobyte-3e4c3b9e-55b7-419d-8543-38c735ae5cd6" released by "delete_volume" :: held 1.468s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:10 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Created reservations ['63e20f05-9cf9-482b-ba52-cf158f5e4e67', 'ce113954-c3e1-41fe-b8cd-e028ea98ab4a', 'bd4c7ca9-0ecc-41ec-9e7d-51c1beeb84ba', '2878d5df-59ef-4c94-b765-16288291f337'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:37:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:10 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:10 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:10 devstack sudo[109666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:37:10 devstack sudo[109666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:10 devstack sudo[109663]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.info" returned: 0 in 0.645s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.345s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:10 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-29ebb88f-d67b-4cf0-bb32-073737b79b8e tempest-VolumesSnapshotTestJSON-1711042781 None] Create snapshot completed successfully Jun 28 14:37:11 devstack sudo[109666]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Acquiring lock "cinder-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.624s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:11 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:37:11 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Deleted volume successfully. Jun 28 14:37:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Lock "cinder-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ef6bb15-94f3-44df-b3f2-09402e9c6951 tempest-VolumesListTestJSON-275563959 None] Lock "cinder-3e4c3b9e-55b7-419d-8543-38c735ae5cd6-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Acquiring lock "cinder-quobyte-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Lock "cinder-quobyte-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:11 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8121aae-b01e-4b2d-9847-cf6c851aeb9c]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:11 devstack sudo[109670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67 Jun 28 14:37:11 devstack sudo[109670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:12 devstack sudo[109670]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67" returned: 0 in 0.767s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:12 devstack sudo[109676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67 Jun 28 14:37:12 devstack sudo[109676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-quobyte-46582a85-41e1-47d3-bcb5-914968a9eb66" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-46582a85-41e1-47d3-bcb5-914968a9eb66" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-quobyte-5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Deleting offline snapshot 5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f of volume 46582a85-41e1-47d3-bcb5-914968a9eb66 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] snapshot_file for this snap is: volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[703b34c8-563d-4e67-b508-7bde88accafa]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:12 devstack sudo[109678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f Jun 28 14:37:12 devstack sudo[109678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:12 devstack sudo[109676]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67" returned: 0 in 0.646s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Lock "cinder-quobyte-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67" released by "delete_volume" :: held 1.452s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Created reservations ['e1050aa1-cb03-4960-bb29-ac5b58835ee4', '2e98c35d-1181-4409-969c-45211646fecf', '5f212ece-c7cf-4d49-ab7b-220e9b9b211f', '4e128597-04b2-4d9d-a8f7-c2639fdf9934'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:12 devstack sudo[109685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:37:12 devstack sudo[109685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:12 devstack sudo[109678]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f" returned: 0 in 0.748s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46582a85-41e1-47d3-bcb5-914968a9eb66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d9dde8-fa59-4265-8868-4b04e82c2076]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:13 devstack sudo[109687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66 Jun 28 14:37:13 devstack sudo[109687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Acquiring lock "cinder-38d31284-f098-4145-9879-5f605448812d-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Lock "cinder-38d31284-f098-4145-9879-5f605448812d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:13 devstack sudo[109685]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.703s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:13 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:37:13 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Deleted volume successfully. Jun 28 14:37:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Acquiring lock "cinder-quobyte-38d31284-f098-4145-9879-5f605448812d" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8ba9c999-c303-4e8c-a919-3e463ecf448a tempest-VolumesListTestJSON-275563959 None] Lock "cinder-2e6ed8b5-8390-4e4d-85fa-6e50d92fbe67-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Lock "cinder-quobyte-38d31284-f098-4145-9879-5f605448812d" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:13 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0153fda-22d4-4241-ba46-547c6c79f231]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-38d31284-f098-4145-9879-5f605448812d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:13 devstack sudo[109687]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66" returned: 0 in 0.757s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:13 devstack sudo[109694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f Jun 28 14:37:13 devstack sudo[109694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:13 devstack sudo[109693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-38d31284-f098-4145-9879-5f605448812d Jun 28 14:37:13 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:14 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-38d31284-f098-4145-9879-5f605448812d" returned: 0 in 0.758s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-38d31284-f098-4145-9879-5f605448812d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:14 devstack sudo[109703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-38d31284-f098-4145-9879-5f605448812d Jun 28 14:37:14 devstack sudo[109703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:14 devstack sudo[109694]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f" returned: 0 in 0.724s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:14 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f Jun 28 14:37:14 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:14 devstack sudo[109703]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-38d31284-f098-4145-9879-5f605448812d" returned: 0 in 0.645s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Lock "cinder-quobyte-38d31284-f098-4145-9879-5f605448812d" released by "delete_volume" :: held 1.465s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:15 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66.5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f" returned: 0 in 0.649s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f" released by "_delete_snapshot" :: held 2.988s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-46582a85-41e1-47d3-bcb5-914968a9eb66" released by "delete_snapshot" :: held 3.009s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Created reservations ['ea8556e8-7aa1-430f-84a6-ef432d2fac39', '4d73dcea-e2b6-4746-b282-379b2d835498', 'cc2eb699-3a34-4f90-90d4-fa00481a85b3', '55802e98-0046-4e08-88b4-7380a5998c86'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Created reservations ['e8792419-7d88-49c6-93fe-46ae19379d0b', '77a88f03-1cdc-4285-bc8f-0a00e72ac02c', 'ef97213d-392d-4c01-b520-6532e9f11b34', 'b40583d2-06c7-4d73-b862-ea89b5c52cdc'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:15 devstack sudo[109709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:37:15 devstack sudo[109709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:15 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Delete snapshot completed successfully. Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-851c5219-050b-420a-9a7e-eba6d89b11a1 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-5021eb7f-fbd8-46d0-82e1-2e4d5b5b5a4f-delete_snapshot" released by "delete_snapshot" :: held 3.248s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:15 devstack sudo[109709]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.628s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:37:15 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Deleted volume successfully. Jun 28 14:37:15 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-412a0bed-0317-448e-9bbc-aac360dd33fa tempest-VolumesListTestJSON-275563959 None] Lock "cinder-38d31284-f098-4145-9879-5f605448812d-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Flow 'volume_create_manager' (9d6b0890-efdf-493e-978e-f0ca07f9b52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (511945b3-f8a9-4a04-a000-2bba15ac33b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (511945b3-f8a9-4a04-a000-2bba15ac33b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-881422514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d6c071-976b-490c-9a39-e95c3007da3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fb5f6268bc45f6825a530faa32637f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:37:17Z,use_quota=True,user_id='8cd58d6a2013458f86348d48f850a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0b15ea-4a57-4142-a080-e1d0fded52fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0b15ea-4a57-4142-a080-e1d0fded52fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71533a1-f39a-48c1-a00f-fee1feaf89ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71533a1-f39a-48c1-a00f-fee1feaf89ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20d6c071-976b-490c-9a39-e95c3007da3b', 'volume_name': 'volume-20d6c071-976b-490c-9a39-e95c3007da3b', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16d8d1e-32e1-486f-9a31-f7c1628c544b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16d8d1e-32e1-486f-9a31-f7c1628c544b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e42e074-66be-4c58-9e5e-fe8eaba5844a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:16 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Volume 20d6c071-976b-490c-9a39-e95c3007da3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20d6c071-976b-490c-9a39-e95c3007da3b', 'volume_size': 1} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-881422514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d6c071-976b-490c-9a39-e95c3007da3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fb5f6268bc45f6825a530faa32637f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:37:17Z,use_quota=True,user_id='8cd58d6a2013458f86348d48f850a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Creating volume 20d6c071-976b-490c-9a39-e95c3007da3b {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:37:16 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:37:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:16 devstack sudo[109714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b 1073741824 Jun 28 14:37:16 devstack sudo[109714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:17 devstack sudo[109714]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b 1073741824" returned: 0 in 0.844s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:17 devstack sudo[109720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b Jun 28 14:37:17 devstack sudo[109720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:18 devstack sudo[109720]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b" returned: 0 in 0.697s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e42e074-66be-4c58-9e5e-fe8eaba5844a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d6c071-976b-490c-9a39-e95c3007da3b', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf590be4-3844-4a99-8830-2d57e93cd964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:18 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Volume volume-20d6c071-976b-490c-9a39-e95c3007da3b (20d6c071-976b-490c-9a39-e95c3007da3b): created successfully Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf590be4-3844-4a99-8830-2d57e93cd964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Flow 'volume_create_manager' (9d6b0890-efdf-493e-978e-f0ca07f9b52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:18 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-1fd6ddbd-f546-487d-a995-d807ca6907e9 tempest-VolumesSnapshotTestJSON-1711042781 None] Created volume successfully. Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Flow 'volume_create_manager' (25080aae-e326-45ae-a796-59afdb29777f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c25027-d356-42d9-b1fc-ecbec0c7acd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c25027-d356-42d9-b1fc-ecbec0c7acd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1816685612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62784d237ee14d8c9137a23e2021ec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:37:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:37:19Z,use_quota=True,user_id='e23b6e9c840b42ff9f12bf6ab74d6fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae25f15-6f17-4072-b2eb-baddda0a01d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae25f15-6f17-4072-b2eb-baddda0a01d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206d0562-530b-47bc-834a-2d813e6b993e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206d0562-530b-47bc-834a-2d813e6b993e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb', 'volume_name': 'volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb', 'volume_size': 2}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d2f266-6b9a-40bd-a41b-88190f204f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d2f266-6b9a-40bd-a41b-88190f204f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe5d32c-d5c8-49e7-b033-38ea3ae31af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:18 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Volume e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb', 'volume_size': 2} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1816685612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62784d237ee14d8c9137a23e2021ec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:37:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:37:19Z,use_quota=True,user_id='e23b6e9c840b42ff9f12bf6ab74d6fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Creating volume e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:37:18 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:37:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb 2147483648 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:18 devstack sudo[109723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb 2147483648 Jun 28 14:37:18 devstack sudo[109723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:19 devstack sudo[109723]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb 2147483648" returned: 0 in 0.884s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:19 devstack sudo[109730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb Jun 28 14:37:19 devstack sudo[109730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:20 devstack sudo[109730]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb" returned: 0 in 0.658s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:37:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.296s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe5d32c-d5c8-49e7-b033-38ea3ae31af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb', 'volume_size': 2}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec3d190-f6a5-46ba-9c32-a34b56e9dafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] Creating offline snapshot 3423c694-ee67-4ac9-ab45-980ce4bf0358 of volume 20d6c071-976b-490c-9a39-e95c3007da3b {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:37:20 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Volume volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb (e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb): created successfully Jun 28 14:37:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec3d190-f6a5-46ba-9c32-a34b56e9dafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Flow 'volume_create_manager' (25080aae-e326-45ae-a796-59afdb29777f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:20 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7ceab6-6867-43f9-95f9-a0dbff88db28]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:20 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f3ea7796-5284-464e-8049-3975d3a393a7 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Created volume successfully. Jun 28 14:37:20 devstack sudo[109734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b Jun 28 14:37:20 devstack sudo[109734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:21 devstack sudo[109734]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b" returned: 0 in 0.761s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:21 devstack sudo[109745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 1G Jun 28 14:37:21 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:21 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 1G" returned: 0 in 0.798s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20d6c071-976b-490c-9a39-e95c3007da3b -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:22 devstack sudo[109750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20d6c071-976b-490c-9a39-e95c3007da3b -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 Jun 28 14:37:22 devstack sudo[109750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:22 devstack sudo[109750]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20d6c071-976b-490c-9a39-e95c3007da3b -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358" returned: 0 in 0.666s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:22 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 is being set with open permissions: ugo+rw Jun 28 14:37:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:22 devstack sudo[109755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 Jun 28 14:37:22 devstack sudo[109755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:23 devstack sudo[109755]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358" returned: 0 in 0.643s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:23 devstack sudo[109758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.info Jun 28 14:37:23 devstack sudo[109758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:23 devstack sudo[109758]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.info" returned: 0 in 0.622s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:23 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.info is being set with open permissions: ugo+rw Jun 28 14:37:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:23 devstack sudo[109761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.info Jun 28 14:37:23 devstack sudo[109761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:24 devstack sudo[109761]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.info" returned: 0 in 0.654s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.247s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.655s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Creating offline snapshot 5c80cf0d-3569-4075-90b9-551db3180804 of volume e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:37:24 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c22555d8-c518-480b-ba43-16c1fd36fd98 tempest-VolumesSnapshotTestJSON-1711042781 None] Create snapshot completed successfully Jun 28 14:37:24 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a963daa0-ae3a-4035-b593-80031b84e968]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:24 devstack sudo[109764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb Jun 28 14:37:24 devstack sudo[109764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:25 devstack sudo[109764]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb" returned: 0 in 0.748s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804 2G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:25 devstack sudo[109769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804 2G Jun 28 14:37:25 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:25 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:37:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Flow 'volume_create_manager' (bca24b1c-3d80-463e-bdc0-0e0ab5daaed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f533f955-5c64-446c-aff7-06e8f782d92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f533f955-5c64-446c-aff7-06e8f782d92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2145011550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fb5f6268bc45f6825a530faa32637f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:37:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3423c694-ee67-4ac9-ab45-980ce4bf0358,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:37:26Z,use_quota=True,user_id='8cd58d6a2013458f86348d48f850a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06be5a13-8f57-4b46-bdee-596370476069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06be5a13-8f57-4b46-bdee-596370476069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515d2cd5-3a64-4a9e-85e0-340959342612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515d2cd5-3a64-4a9e-85e0-340959342612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa', 'volume_name': 'volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa', 'volume_size': 2, 'snapshot_id': '3423c694-ee67-4ac9-ab45-980ce4bf0358'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc8cf8b-8790-43cb-af5a-76cdfdcbcca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc8cf8b-8790-43cb-af5a-76cdfdcbcca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367a959c-6f9f-4658-8dfe-dd3173001da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:25 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Volume 1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa', 'volume_size': 2, 'snapshot_id': '3423c694-ee67-4ac9-ab45-980ce4bf0358'} Jun 28 14:37:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:26 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804 2G" returned: 0 in 0.828s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:26 devstack sudo[109774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804 Jun 28 14:37:26 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:26 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804" returned: 0 in 0.692s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:26 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804 is being set with open permissions: ugo+rw Jun 28 14:37:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:26 devstack sudo[109779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804 Jun 28 14:37:26 devstack sudo[109779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:27 devstack sudo[109779]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804" returned: 0 in 0.619s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:27 devstack sudo[109782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.info Jun 28 14:37:27 devstack sudo[109782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:28 devstack sudo[109782]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.info" returned: 0 in 0.645s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:28 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.info is being set with open permissions: ugo+rw Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:28 devstack sudo[109785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.info Jun 28 14:37:28 devstack sudo[109785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:28 devstack sudo[109785]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.info" returned: 0 in 0.636s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.266s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.998s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-quobyte-3423c694-ee67-4ac9-ab45-980ce4bf0358-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa" by "_create_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-3423c694-ee67-4ac9-ab45-980ce4bf0358-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Creating volume 1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa from snapshot 3423c694-ee67-4ac9-ab45-980ce4bf0358 {{(pid=93561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-quobyte-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa" by "_copy_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:28 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-2660aa64-3e9a-42fa-9d16-0fb48e5a241c tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Create snapshot completed successfully Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] snapshot: 3423c694-ee67-4ac9-ab45-980ce4bf0358, volume: 1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa, {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[44736288-e114-4f99-947c-7623164342ad]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:29 devstack sudo[109788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 Jun 28 14:37:29 devstack sudo[109788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Acquiring lock "cinder-5c80cf0d-3569-4075-90b9-551db3180804-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "cinder-5c80cf0d-3569-4075-90b9-551db3180804-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Acquiring lock "cinder-quobyte-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "cinder-quobyte-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Acquiring lock "cinder-quobyte-5c80cf0d-3569-4075-90b9-551db3180804" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "cinder-quobyte-5c80cf0d-3569-4075-90b9-551db3180804" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Deleting offline snapshot 5c80cf0d-3569-4075-90b9-551db3180804 of volume e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] snapshot_file for this snap is: volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dbe76e-f615-4c90-bb2e-36c21fb6eb28]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:29 devstack sudo[109790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804 Jun 28 14:37:29 devstack sudo[109790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:29 devstack sudo[109788]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358" returned: 0 in 0.758s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20d6c071-976b-490c-9a39-e95c3007da3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Creating direct copy from snapshot {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[331a77e4-bfed-4cf2-b383-46e7c846ef86]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:29 devstack sudo[109795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b Jun 28 14:37:29 devstack sudo[109795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:30 devstack sudo[109790]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804" returned: 0 in 0.775s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:37:30 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[619a7dfb-5b38-43a6-8752-83162669d075]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:30 devstack sudo[109801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb Jun 28 14:37:30 devstack sudo[109801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:30 devstack sudo[109795]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b" returned: 0 in 0.748s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:30 devstack cinder-volume[93561]: DEBUG cinder.utils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Path /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa not found in is_blk_device check {{(pid=93561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 28 14:37:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:30 devstack sudo[109806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa Jun 28 14:37:30 devstack sudo[109806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:30 devstack sudo[109801]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb" returned: 0 in 0.767s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:31 devstack sudo[109811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804 Jun 28 14:37:31 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:32 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804" returned: 0 in 1.266s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:32 devstack sudo[109827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804 Jun 28 14:37:32 devstack sudo[109827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:33 devstack sudo[109827]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb.5c80cf0d-3569-4075-90b9-551db3180804" returned: 0 in 1.481s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:33 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "cinder-quobyte-5c80cf0d-3569-4075-90b9-551db3180804" released by "_delete_snapshot" :: held 4.437s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:33 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "cinder-quobyte-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb" released by "delete_snapshot" :: held 4.467s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:33 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Created reservations ['ce3dee26-e28e-4845-94a6-9a5bdee463d9', '2317393a-a8b9-40f4-833f-86cb03332890', 'cdad2c38-11b6-429f-8d9a-fe84d0d0c0ee', '1fa978b3-f706-43fd-abcf-45904ea470a8'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:37:34 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Delete snapshot completed successfully. Jun 28 14:37:34 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-d953ef24-8736-4231-94ad-358531d5b155 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "cinder-5c80cf0d-3569-4075-90b9-551db3180804-delete_snapshot" released by "delete_snapshot" :: held 4.787s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Acquiring lock "cinder-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "cinder-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Acquiring lock "cinder-quobyte-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "cinder-quobyte-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb" acquired by "delete_volume" :: waited 0.020s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:35 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb17105-c3c5-4a7c-a7d6-2d2f0c94b854]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:35 devstack sudo[109831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb Jun 28 14:37:35 devstack sudo[109831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:35 devstack sudo[109806]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa" returned: 0 in 5.041s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:35 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd86a307-aa82-4fa8-81ad-3f871290be4d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:35 devstack sudo[109833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b Jun 28 14:37:35 devstack sudo[109833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:36 devstack sudo[109831]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb" returned: 0 in 0.841s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:36 devstack sudo[109838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb Jun 28 14:37:36 devstack sudo[109838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:36 devstack sudo[109833]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b" returned: 0 in 0.943s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:36 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Image conversion details: src /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:37:36 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Converted 1024.00 MB image at 203.07 MB/s Jun 28 14:37:36 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa is being set with open permissions: ugo+rw Jun 28 14:37:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:36 devstack sudo[109843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa Jun 28 14:37:36 devstack sudo[109843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:36 devstack sudo[109838]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb" returned: 0 in 0.631s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "cinder-quobyte-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb" released by "delete_volume" :: held 1.572s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:36 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Created reservations ['b2c1de9d-f828-4283-886d-caa6147ff408', '3ebdee83-b500-40f5-b766-46d40e70fe90', 'f0854352-50c8-4dc0-9bd0-c6d267b92ff8', '0b27ff52-7710-4a95-a9b2-c544b2ec7615'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:37:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:36 devstack sudo[109846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:37:36 devstack sudo[109846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:37 devstack sudo[109843]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa" returned: 0 in 0.634s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa" released by "_copy_volume_from_snapshot" :: held 8.234s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-3423c694-ee67-4ac9-ab45-980ce4bf0358-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa" released by "_create_volume_from_snapshot" :: held 8.271s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.293s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367a959c-6f9f-4658-8dfe-dd3173001da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa', 'volume_size': 2, 'snapshot_id': '3423c694-ee67-4ac9-ab45-980ce4bf0358'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc54dff-f47d-4081-b6e8-1e52b42728fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:37 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Volume volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa (1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa): created successfully Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc54dff-f47d-4081-b6e8-1e52b42728fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Flow 'volume_create_manager' (bca24b1c-3d80-463e-bdc0-0e0ab5daaed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:37 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c6f278db-bb6a-410b-8dce-1329bf03e754 tempest-VolumesSnapshotTestJSON-1711042781 None] Created volume successfully. Jun 28 14:37:37 devstack sudo[109846]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.642s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:37:37 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Deleted volume successfully. Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fc0e543e-5923-4b4d-9eb9-6b3920c569f6 tempest-VolumesSnapshotNegativeTestJSON-461714039 None] Lock "cinder-e67ca3bd-cc7f-4e9a-9ef7-d8be981b25bb-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-quobyte-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae992ce5-2cb4-4737-a2c0-24b1b3817c70]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:37 devstack sudo[109850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:37:37 devstack sudo[109850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:37 devstack sudo[109851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa Jun 28 14:37:37 devstack sudo[109851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:38 devstack sudo[109850]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.718s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:37:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:37:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 28 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:37:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:37:38 devstack sudo[109851]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa" returned: 0 in 0.862s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:38 devstack sudo[109858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa Jun 28 14:37:38 devstack sudo[109858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:39 devstack sudo[109858]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa" returned: 0 in 0.638s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa" released by "delete_volume" :: held 1.559s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:39 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Created reservations ['e85c3d79-e128-4722-95dd-47a17812e6ed', 'b249840b-cd1a-4c8b-bc05-1afcee901383', 'bb096445-0601-45c2-b54e-1d216c800ba9', '756fcdc5-93d0-4d13-8e0e-28a60674a61a'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:37:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:39 devstack sudo[109861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:37:39 devstack sudo[109861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-3423c694-ee67-4ac9-ab45-980ce4bf0358-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-3423c694-ee67-4ac9-ab45-980ce4bf0358-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-quobyte-20d6c071-976b-490c-9a39-e95c3007da3b" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-20d6c071-976b-490c-9a39-e95c3007da3b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-quobyte-3423c694-ee67-4ac9-ab45-980ce4bf0358" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-3423c694-ee67-4ac9-ab45-980ce4bf0358" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Deleting offline snapshot 3423c694-ee67-4ac9-ab45-980ce4bf0358 of volume 20d6c071-976b-490c-9a39-e95c3007da3b {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:37:40 devstack sudo[109861]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] snapshot_file for this snap is: volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:37:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.689s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:40 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:37:40 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Deleted volume successfully. Jun 28 14:37:40 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[89248b8f-e485-4162-93b6-8d50cd0c6df3]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8a4eafa5-d413-4b3d-97f7-781bd9de842b tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-1ccbd8c7-edbf-421f-a92e-9a3e8eff40fa-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:40 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 Jun 28 14:37:40 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:41 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358" returned: 0 in 0.821s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:41 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20d6c071-976b-490c-9a39-e95c3007da3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:37:41 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[34012ca9-c620-44ed-a14a-f7a48d5ad750]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:41 devstack sudo[109871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b Jun 28 14:37:41 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:41 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b" returned: 0 in 0.810s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:41 devstack sudo[109877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 Jun 28 14:37:41 devstack sudo[109877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:42 devstack sudo[109877]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358" returned: 0 in 0.792s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:42 devstack sudo[109918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358 Jun 28 14:37:42 devstack sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:43 devstack sudo[109918]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b.3423c694-ee67-4ac9-ab45-980ce4bf0358" returned: 0 in 0.689s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:43 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:UPDATE=100,cinder:DELETE=12,cinder:SELECT=88,cinder:INSERT=28 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:37:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-3423c694-ee67-4ac9-ab45-980ce4bf0358" released by "_delete_snapshot" :: held 3.260s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-20d6c071-976b-490c-9a39-e95c3007da3b" released by "delete_snapshot" :: held 3.287s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:43 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Created reservations ['dd935288-9250-4a6a-b289-37d1526ca48a', 'ec42c41b-16a6-45a1-b358-d7ff0b85ea3a', '06140a67-ef47-4567-b7ec-2813269e4454', 'e000c33c-386e-4601-b54b-fa8fe7026c4a'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:37:43 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Delete snapshot completed successfully. Jun 28 14:37:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f4477f52-e12f-43ac-9306-6b9dd87c6f37 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-3423c694-ee67-4ac9-ab45-980ce4bf0358-delete_snapshot" released by "delete_snapshot" :: held 3.423s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-20d6c071-976b-490c-9a39-e95c3007da3b-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-20d6c071-976b-490c-9a39-e95c3007da3b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-quobyte-20d6c071-976b-490c-9a39-e95c3007da3b" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-20d6c071-976b-490c-9a39-e95c3007da3b" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:44 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4e41c4-e8cd-40e5-b938-e2ec06499b04]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:44 devstack sudo[109921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b Jun 28 14:37:44 devstack sudo[109921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:45 devstack sudo[109921]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b" returned: 0 in 0.844s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:45 devstack sudo[109926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b Jun 28 14:37:45 devstack sudo[109926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:46 devstack sudo[109926]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-20d6c071-976b-490c-9a39-e95c3007da3b" returned: 0 in 0.659s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-20d6c071-976b-490c-9a39-e95c3007da3b" released by "delete_volume" :: held 1.570s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:46 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Created reservations ['d34c0eae-805d-42af-8e1a-1c60f6f8dd37', '31be9ad2-db72-47aa-89fc-e5afb24eccdb', '89574fd7-3853-43d6-8fd1-891b1f637a49', '45a0ac81-8fdc-4278-adc0-41d16976a9a6'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:37:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:46 devstack sudo[109929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:37:46 devstack sudo[109929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:46 devstack sudo[109929]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.691s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:46 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:37:46 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Deleted volume successfully. Jun 28 14:37:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0ed26629-1245-4eef-bddb-df24442b1eaa tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-20d6c071-976b-490c-9a39-e95c3007da3b-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Flow 'volume_create_manager' (05f3ffdf-2f19-442b-b5e6-c80bdefdd1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4cd07f-507e-4c7a-a68d-e779c6ad0d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4cd07f-507e-4c7a-a68d-e779c6ad0d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-215705167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ee4b0b-40a9-40f0-aa9f-39ddddc718d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fb5f6268bc45f6825a530faa32637f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:37:47Z,use_quota=True,user_id='8cd58d6a2013458f86348d48f850a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ad96b6-af11-472d-94b2-d9b1c7cf727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ad96b6-af11-472d-94b2-d9b1c7cf727b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55dd720-4727-48b6-b165-19e1d970a899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55dd720-4727-48b6-b165-19e1d970a899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72ee4b0b-40a9-40f0-aa9f-39ddddc718d1', 'volume_name': 'volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d0a82d-5184-4e2f-9bbb-33a2a864f5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d0a82d-5184-4e2f-9bbb-33a2a864f5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c19f75-68cd-49af-b62f-9a1a2a6b6aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:47 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Volume 72ee4b0b-40a9-40f0-aa9f-39ddddc718d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1', 'volume_size': 1} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-215705167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ee4b0b-40a9-40f0-aa9f-39ddddc718d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fb5f6268bc45f6825a530faa32637f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:37:47Z,use_quota=True,user_id='8cd58d6a2013458f86348d48f850a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Creating volume 72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:37:47 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:37:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:47 devstack sudo[109932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 1073741824 Jun 28 14:37:47 devstack sudo[109932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:48 devstack sudo[109932]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 1073741824" returned: 0 in 0.880s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:48 devstack sudo[109938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 Jun 28 14:37:48 devstack sudo[109938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:48 devstack sudo[109938]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1" returned: 0 in 0.679s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:37:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c19f75-68cd-49af-b62f-9a1a2a6b6aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6216b70c-dc4a-4a77-bc44-3f517f9dc5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:49 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Volume volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 (72ee4b0b-40a9-40f0-aa9f-39ddddc718d1): created successfully Jun 28 14:37:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6216b70c-dc4a-4a77-bc44-3f517f9dc5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Flow 'volume_create_manager' (05f3ffdf-2f19-442b-b5e6-c80bdefdd1c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:49 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a259cd2a-3fca-43dd-82c1-ffd74d74f988 tempest-VolumesSnapshotTestJSON-1711042781 None] Created volume successfully. Jun 28 14:37:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] Creating offline snapshot d10fa834-4eef-4ddf-8fcf-778ea48c3f48 of volume 72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:37:49 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd571df6-21f4-4567-825f-5e8a2f8276ba]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:49 devstack sudo[109941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 Jun 28 14:37:49 devstack sudo[109941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:50 devstack sudo[109941]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1" returned: 0 in 0.757s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:50 devstack sudo[109947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 1G Jun 28 14:37:50 devstack sudo[109947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:51 devstack sudo[109947]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 1G" returned: 0 in 0.915s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:51 devstack sudo[109953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 Jun 28 14:37:51 devstack sudo[109953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:51 devstack sudo[109953]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48" returned: 0 in 0.742s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:51 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 is being set with open permissions: ugo+rw Jun 28 14:37:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:52 devstack sudo[109959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 Jun 28 14:37:52 devstack sudo[109959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:52 devstack sudo[109959]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48" returned: 0 in 0.717s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:52 devstack sudo[109962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.info Jun 28 14:37:52 devstack sudo[109962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:53 devstack sudo[109962]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.info" returned: 0 in 0.699s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:53 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.info is being set with open permissions: ugo+rw Jun 28 14:37:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:53 devstack sudo[109965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.info Jun 28 14:37:53 devstack sudo[109965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:54 devstack sudo[109965]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.info" returned: 0 in 0.740s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.672s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:54 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-2d1f3eac-41f5-4deb-908b-e1eb6e258946 tempest-VolumesSnapshotTestJSON-1711042781 None] Create snapshot completed successfully Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Flow 'volume_create_manager' (44fa15fd-6ce9-4eb0-a86d-ddb22818cb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c132d8b4-22fd-49da-9a8e-e8f39adbd823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c132d8b4-22fd-49da-9a8e-e8f39adbd823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-677953705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f608a64c-22c2-479a-bf24-b1010c40da18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fb5f6268bc45f6825a530faa32637f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d10fa834-4eef-4ddf-8fcf-778ea48c3f48,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:37:55Z,use_quota=True,user_id='8cd58d6a2013458f86348d48f850a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e7453f-6f40-498d-9201-d77bb767ab2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e7453f-6f40-498d-9201-d77bb767ab2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a97784-dfba-470b-abbb-28d1d314eac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a97784-dfba-470b-abbb-28d1d314eac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f608a64c-22c2-479a-bf24-b1010c40da18', 'volume_name': 'volume-f608a64c-22c2-479a-bf24-b1010c40da18', 'volume_size': 1, 'snapshot_id': 'd10fa834-4eef-4ddf-8fcf-778ea48c3f48'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b42627-64ac-4e4f-9e73-ca2a7d4f6e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b42627-64ac-4e4f-9e73-ca2a7d4f6e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ceef65-b62d-4c05-b337-14c5dd3ba702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:37:55 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Volume f608a64c-22c2-479a-bf24-b1010c40da18: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f608a64c-22c2-479a-bf24-b1010c40da18', 'volume_size': 1, 'snapshot_id': 'd10fa834-4eef-4ddf-8fcf-778ea48c3f48'} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-quobyte-d10fa834-4eef-4ddf-8fcf-778ea48c3f48-f608a64c-22c2-479a-bf24-b1010c40da18" by "_create_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-d10fa834-4eef-4ddf-8fcf-778ea48c3f48-f608a64c-22c2-479a-bf24-b1010c40da18" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Creating volume f608a64c-22c2-479a-bf24-b1010c40da18 from snapshot d10fa834-4eef-4ddf-8fcf-778ea48c3f48 {{(pid=93561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-quobyte-f608a64c-22c2-479a-bf24-b1010c40da18" by "_copy_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-f608a64c-22c2-479a-bf24-b1010c40da18" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] snapshot: d10fa834-4eef-4ddf-8fcf-778ea48c3f48, volume: f608a64c-22c2-479a-bf24-b1010c40da18, {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef665906-0a45-4545-b76c-525b6a8b9a80]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:55 devstack sudo[109968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 Jun 28 14:37:55 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:56 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48" returned: 0 in 0.905s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:37:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 28 14:37:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Creating direct copy from snapshot {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 28 14:37:56 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[80025bac-ecb2-49a4-86ce-d7f88ab6f3c5]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:37:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:56 devstack sudo[109973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 Jun 28 14:37:56 devstack sudo[109973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:37:57 devstack sudo[109973]: pam_unix(sudo:session): session closed for user root Jun 28 14:37:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1" returned: 0 in 0.880s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:37:57 devstack cinder-volume[93561]: DEBUG cinder.utils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Path /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f608a64c-22c2-479a-bf24-b1010c40da18 not found in is_blk_device check {{(pid=93561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 28 14:37:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f608a64c-22c2-479a-bf24-b1010c40da18 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:37:57 devstack sudo[109978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f608a64c-22c2-479a-bf24-b1010c40da18 Jun 28 14:37:57 devstack sudo[109978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:02 devstack sudo[109978]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f608a64c-22c2-479a-bf24-b1010c40da18" returned: 0 in 5.501s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:02 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[181e8da9-5c0d-426e-8aca-4851ac4599a7]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:02 devstack sudo[109992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 Jun 28 14:38:02 devstack sudo[109992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:03 devstack sudo[109992]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1" returned: 0 in 0.970s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:03 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Image conversion details: src /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f608a64c-22c2-479a-bf24-b1010c40da18 {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:38:03 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Converted 1024.00 MB image at 186.10 MB/s Jun 28 14:38:03 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f608a64c-22c2-479a-bf24-b1010c40da18 is being set with open permissions: ugo+rw Jun 28 14:38:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f608a64c-22c2-479a-bf24-b1010c40da18 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:03 devstack sudo[109997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f608a64c-22c2-479a-bf24-b1010c40da18 Jun 28 14:38:03 devstack sudo[109997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:04 devstack sudo[109997]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f608a64c-22c2-479a-bf24-b1010c40da18" returned: 0 in 0.692s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:04 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-f608a64c-22c2-479a-bf24-b1010c40da18" released by "_copy_volume_from_snapshot" :: held 9.054s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:38:04 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-d10fa834-4eef-4ddf-8fcf-778ea48c3f48-f608a64c-22c2-479a-bf24-b1010c40da18" released by "_create_volume_from_snapshot" :: held 9.085s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:38:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.104s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:38:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ceef65-b62d-4c05-b337-14c5dd3ba702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f608a64c-22c2-479a-bf24-b1010c40da18', 'volume_size': 1, 'snapshot_id': 'd10fa834-4eef-4ddf-8fcf-778ea48c3f48'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e378eb88-5d1e-4c3f-bd4c-b2d70576a6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:04 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Volume volume-f608a64c-22c2-479a-bf24-b1010c40da18 (f608a64c-22c2-479a-bf24-b1010c40da18): created successfully Jun 28 14:38:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e378eb88-5d1e-4c3f-bd4c-b2d70576a6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Flow 'volume_create_manager' (44fa15fd-6ce9-4eb0-a86d-ddb22818cb7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:38:04 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-6ab68b0b-0480-480b-afd8-443913a85743 tempest-VolumesSnapshotTestJSON-1711042781 None] Created volume successfully. Jun 28 14:38:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-f608a64c-22c2-479a-bf24-b1010c40da18-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:38:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-f608a64c-22c2-479a-bf24-b1010c40da18-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:38:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-quobyte-f608a64c-22c2-479a-bf24-b1010c40da18" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:38:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-f608a64c-22c2-479a-bf24-b1010c40da18" acquired by "delete_volume" :: waited 0.013s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:38:05 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f28b4da-66e9-4c11-b678-c002eb9d7e61]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f608a64c-22c2-479a-bf24-b1010c40da18 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:05 devstack sudo[110000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f608a64c-22c2-479a-bf24-b1010c40da18 Jun 28 14:38:05 devstack sudo[110000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:06 devstack sudo[110000]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f608a64c-22c2-479a-bf24-b1010c40da18" returned: 0 in 0.801s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f608a64c-22c2-479a-bf24-b1010c40da18 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:06 devstack sudo[110005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f608a64c-22c2-479a-bf24-b1010c40da18 Jun 28 14:38:06 devstack sudo[110005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:07 devstack sudo[110005]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f608a64c-22c2-479a-bf24-b1010c40da18" returned: 0 in 0.677s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-f608a64c-22c2-479a-bf24-b1010c40da18" released by "delete_volume" :: held 1.527s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=79,cinder:UPDATE=91,cinder:INSERT=15,cinder:DELETE=7 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Created reservations ['23ecb4f3-6efc-45eb-8156-4ec73278973a', '17d0d6d5-1177-4d15-b2a1-044b62dce3d2', 'a7845ad8-bdd5-4017-aa8b-436277bb83fa', '752b33f9-cc67-44fd-8742-9a9fec6c3176'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:07 devstack sudo[110008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:38:07 devstack sudo[110008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-d10fa834-4eef-4ddf-8fcf-778ea48c3f48-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-d10fa834-4eef-4ddf-8fcf-778ea48c3f48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-quobyte-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-quobyte-d10fa834-4eef-4ddf-8fcf-778ea48c3f48" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-d10fa834-4eef-4ddf-8fcf-778ea48c3f48" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Deleting offline snapshot d10fa834-4eef-4ddf-8fcf-778ea48c3f48 of volume 72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:38:07 devstack sudo[110008]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] snapshot_file for this snap is: volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.700s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:38:07 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Deleted volume successfully. Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d95a4fe-fff9-4173-807d-a76537e12193]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:07 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-75f91f2c-a866-4bd2-bfe4-28781b7c9be6 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-f608a64c-22c2-479a-bf24-b1010c40da18-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:38:07 devstack sudo[110011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 Jun 28 14:38:07 devstack sudo[110011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:08 devstack sudo[110011]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48" returned: 0 in 0.780s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:38:08 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9746c6-72dc-45a3-a3f2-da5a6f5161f8]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:08 devstack sudo[110016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 Jun 28 14:38:08 devstack sudo[110016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Flow 'volume_create_manager' (020eb9df-8603-4f3e-995a-ea4d60d60ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89106646-288c-4276-ab12-8b10c3ab1a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89106646-288c-4276-ab12-8b10c3ab1a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1307319545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16001fca3124bd38d724926a6d98d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:38:09Z,use_quota=True,user_id='f4f310e9b85b4dc9822878838eed9232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(605f1d02-f974-48c6-9b9a-fd12786d864a),volume_type_id=605f1d02-f974-48c6-9b9a-fd12786d864a)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5966d7-dd14-4141-a177-b7c5a94f1b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5966d7-dd14-4141-a177-b7c5a94f1b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c29b0b9-5305-486a-ae37-7f0d184a6498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c29b0b9-5305-486a-ae37-7f0d184a6498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb', 'volume_name': 'volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca457dd-fa42-4a04-b830-cd32afa3ba74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca457dd-fa42-4a04-b830-cd32afa3ba74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f360a1e9-4913-4800-a3f2-0cef5eabdb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:09 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Volume b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb', 'volume_size': 1} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:38:09 devstack sudo[110016]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1307319545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16001fca3124bd38d724926a6d98d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:38:09Z,use_quota=True,user_id='f4f310e9b85b4dc9822878838eed9232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(605f1d02-f974-48c6-9b9a-fd12786d864a),volume_type_id=605f1d02-f974-48c6-9b9a-fd12786d864a)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Creating volume b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:38:09 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1" returned: 0 in 0.830s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:09 devstack sudo[110021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb 1073741824 Jun 28 14:38:09 devstack sudo[110021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:09 devstack sudo[110022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 Jun 28 14:38:09 devstack sudo[110022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Flow 'volume_create_manager' (4a71cdc0-de17-4cf4-8d42-e9c173cc1fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c5f9d6-962a-465d-a5f0-65073052e931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c5f9d6-962a-465d-a5f0-65073052e931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-300637106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8138604c-2442-45de-a180-248d02d7cf9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16001fca3124bd38d724926a6d98d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:38:10Z,use_quota=True,user_id='f4f310e9b85b4dc9822878838eed9232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ae151a7-f8c7-4c7b-8735-e15e17cb4f2c),volume_type_id=7ae151a7-f8c7-4c7b-8735-e15e17cb4f2c)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6448dc67-0c7b-4594-b729-620ff213e124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6448dc67-0c7b-4594-b729-620ff213e124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb731588-2ffa-4100-966c-17be682b5eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb731588-2ffa-4100-966c-17be682b5eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8138604c-2442-45de-a180-248d02d7cf9d', 'volume_name': 'volume-8138604c-2442-45de-a180-248d02d7cf9d', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092d7bd2-0222-45d9-b9ba-84e0ae5732a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092d7bd2-0222-45d9-b9ba-84e0ae5732a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309a72ad-a99b-4049-a651-dbb1ff302470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:09 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Volume 8138604c-2442-45de-a180-248d02d7cf9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8138604c-2442-45de-a180-248d02d7cf9d', 'volume_size': 1} Jun 28 14:38:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:38:10 devstack sudo[110022]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48" returned: 0 in 0.981s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:10 devstack sudo[110034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48 Jun 28 14:38:10 devstack sudo[110034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:10 devstack sudo[110021]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb 1073741824" returned: 0 in 1.120s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:10 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:38:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Flow 'volume_create_manager' (6dcb1488-c77a-45ca-8a14-dbc80ced8b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:38:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e01f57-186b-4b8b-98f8-2975f9866df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e01f57-186b-4b8b-98f8-2975f9866df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1841686537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0799cc0-993b-470b-b034-d9906dcb54b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16001fca3124bd38d724926a6d98d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:38:11Z,use_quota=True,user_id='f4f310e9b85b4dc9822878838eed9232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f323370-b95c-4f12-b9d0-1580e41318c7),volume_type_id=6f323370-b95c-4f12-b9d0-1580e41318c7)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d07ef06-d883-44a2-abfc-b9c1d33471d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d07ef06-d883-44a2-abfc-b9c1d33471d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34881efc-6db5-4655-83a8-155fb852f7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:10 devstack cinder-volume[93561]: DEBUG cinder.image.glance [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Creating Keystone auth plugin from conf {{(pid=93561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 28 14:38:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:10 devstack sudo[110036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb Jun 28 14:38:10 devstack sudo[110036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34881efc-6db5-4655-83a8-155fb852f7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c0799cc0-993b-470b-b034-d9906dcb54b8', 'volume_name': 'volume-c0799cc0-993b-470b-b034-d9906dcb54b8', 'volume_size': 1, 'image_id': 'f511976b-7f80-455d-9a7e-f9c51d9b7960', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f511976b-7f80-455d-9a7e-f9c51d9b7960', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--226574380', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e16001fca3124bd38d724926a6d98d5b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f511976b-7f80-455d-9a7e-f9c51d9b7960', 'created_at': datetime.datetime(2026, 6, 28, 12, 38, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 38, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f511976b-7f80-455d-9a7e-f9c51d9b7960/file', 'properties': {}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815cbf8f-6f9f-45ba-b5b6-b886421ccdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815cbf8f-6f9f-45ba-b5b6-b886421ccdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c5ffa5-51a7-4ac2-828c-704703a83f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:11 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Volume c0799cc0-993b-470b-b034-d9906dcb54b8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c0799cc0-993b-470b-b034-d9906dcb54b8', 'volume_size': 1, 'image_id': 'f511976b-7f80-455d-9a7e-f9c51d9b7960', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f511976b-7f80-455d-9a7e-f9c51d9b7960', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--226574380', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e16001fca3124bd38d724926a6d98d5b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f511976b-7f80-455d-9a7e-f9c51d9b7960', 'created_at': datetime.datetime(2026, 6, 28, 12, 38, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 38, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f511976b-7f80-455d-9a7e-f9c51d9b7960/file', 'properties': {}}, 'image_service': } Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Trying to clone c0799cc0-993b-470b-b034-d9906dcb54b8 from image f511976b-7f80-455d-9a7e-f9c51d9b7960 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f511976b-7f80-455d-9a7e-f9c51d9b7960', 'metadata': {}}]). {{(pid=93561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 28 14:38:11 devstack sudo[110034]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1.d10fa834-4eef-4ddf-8fcf-778ea48c3f48" returned: 0 in 0.773s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-d10fa834-4eef-4ddf-8fcf-778ea48c3f48" released by "_delete_snapshot" :: held 3.479s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1" released by "delete_snapshot" :: held 3.510s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Created reservations ['8ae17699-3ff7-4b4e-90d7-14d8051a2849', '4f6bfea3-2b01-4094-b4f1-9497bfe8ae64', '9f5fab1d-8f25-4232-b2ce-e926992d979d', '238a8e29-1eb0-4032-84bb-3e234a1d5160'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:38:11 devstack sudo[110036]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb" returned: 0 in 0.727s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.595s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-300637106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8138604c-2442-45de-a180-248d02d7cf9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16001fca3124bd38d724926a6d98d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:38:10Z,use_quota=True,user_id='f4f310e9b85b4dc9822878838eed9232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ae151a7-f8c7-4c7b-8735-e15e17cb4f2c),volume_type_id=7ae151a7-f8c7-4c7b-8735-e15e17cb4f2c)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Creating volume 8138604c-2442-45de-a180-248d02d7cf9d {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:38:11 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8138604c-2442-45de-a180-248d02d7cf9d 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:11 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Delete snapshot completed successfully. Jun 28 14:38:11 devstack sudo[110040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8138604c-2442-45de-a180-248d02d7cf9d 1073741824 Jun 28 14:38:11 devstack sudo[110040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f360a1e9-4913-4800-a3f2-0cef5eabdb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e924aa-1c58-49f7-8215-042c044691b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b57887a6-09f4-46da-8e49-88760b589271 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-d10fa834-4eef-4ddf-8fcf-778ea48c3f48-delete_snapshot" released by "delete_snapshot" :: held 3.728s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:38:11 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Volume volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb (b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb): created successfully Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e924aa-1c58-49f7-8215-042c044691b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:11 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Flow 'volume_create_manager' (020eb9df-8603-4f3e-995a-ea4d60d60ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:38:11 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-9c317f5b-8ede-4499-84b9-23c23232baff tempest-TestInstancesWithCinderVolumes-1137798716 None] Created volume successfully. Jun 28 14:38:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:38:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:38:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-quobyte-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:38:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:38:12 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f348d4-12dd-4f1a-8836-04bf48701cc9]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:12 devstack sudo[110040]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8138604c-2442-45de-a180-248d02d7cf9d 1073741824" returned: 0 in 0.884s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:12 devstack sudo[110046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 Jun 28 14:38:12 devstack sudo[110046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8138604c-2442-45de-a180-248d02d7cf9d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:12 devstack sudo[110048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8138604c-2442-45de-a180-248d02d7cf9d Jun 28 14:38:12 devstack sudo[110048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:12 devstack sudo[110046]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1" returned: 0 in 0.756s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:13 devstack sudo[110054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1 Jun 28 14:38:13 devstack sudo[110054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:13 devstack sudo[110048]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8138604c-2442-45de-a180-248d02d7cf9d" returned: 0 in 0.732s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309a72ad-a99b-4049-a651-dbb1ff302470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8138604c-2442-45de-a180-248d02d7cf9d', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba665cbf-2028-4958-8d6a-6dd2718de3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:13 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Volume volume-8138604c-2442-45de-a180-248d02d7cf9d (8138604c-2442-45de-a180-248d02d7cf9d): created successfully Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba665cbf-2028-4958-8d6a-6dd2718de3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Flow 'volume_create_manager' (4a71cdc0-de17-4cf4-8d42-e9c173cc1fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:38:13 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-36adec21-d61a-4c06-b49a-fcaf8781c785 tempest-TestInstancesWithCinderVolumes-1137798716 None] Created volume successfully. Jun 28 14:38:13 devstack sudo[110054]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1" returned: 0 in 0.638s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1" released by "delete_volume" :: held 1.464s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Created reservations ['c33c6161-8b01-4c10-b3c6-dc8fb59a20db', 'f8b04085-dc5b-41a3-8f69-05eb290c2b91', '4620769f-325f-49b4-a051-1bf9b942725b', 'dd31398c-414b-4371-b65c-277a300f902a'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:38:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:13 devstack sudo[110057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:38:13 devstack sudo[110057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:14 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-46582a85-41e1-47d3-bcb5-914968a9eb66-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:38:14 devstack sudo[110057]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:14 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-46582a85-41e1-47d3-bcb5-914968a9eb66-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:38:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.697s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:14 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:38:14 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Deleted volume successfully. Jun 28 14:38:14 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "cinder-quobyte-46582a85-41e1-47d3-bcb5-914968a9eb66" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:38:14 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4c116a98-727f-483f-8335-a5877906e16a tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-72ee4b0b-40a9-40f0-aa9f-39ddddc718d1-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:38:14 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-46582a85-41e1-47d3-bcb5-914968a9eb66" acquired by "delete_volume" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:38:14 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e8b30e-5f0c-409f-bbb5-95523c1a2bb9]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:14 devstack sudo[110060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66 Jun 28 14:38:14 devstack sudo[110060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:14 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f511976b-7f80-455d-9a7e-f9c51d9b7960_x6nscp_sdevstack@QuobyteHD, size 20.69 MB, duration 3.70 sec {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 28 14:38:14 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Image download 20.69 MB at 5.59 MB/s Jun 28 14:38:14 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec357f1-2abf-4212-82b8-610067c82e94]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f511976b-7f80-455d-9a7e-f9c51d9b7960_x6nscp_sdevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:14 devstack sudo[110062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f511976b-7f80-455d-9a7e-f9c51d9b7960_x6nscp_sdevstack@QuobyteHD Jun 28 14:38:14 devstack sudo[110062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:15 devstack sudo[110060]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66" returned: 0 in 0.750s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:15 devstack sudo[110067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66 Jun 28 14:38:15 devstack sudo[110067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:15 devstack sudo[110062]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f511976b-7f80-455d-9a7e-f9c51d9b7960_x6nscp_sdevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:15 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Temporary image f511976b-7f80-455d-9a7e-f9c51d9b7960 is fetched for user f4f310e9b85b4dc9822878838eed9232. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 28 14:38:15 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37cc9ef-754c-4309-b841-4057b53e0c7d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f511976b-7f80-455d-9a7e-f9c51d9b7960_x6nscp_sdevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:15 devstack sudo[110072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f511976b-7f80-455d-9a7e-f9c51d9b7960_x6nscp_sdevstack@QuobyteHD Jun 28 14:38:15 devstack sudo[110072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:15 devstack sudo[110067]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-46582a85-41e1-47d3-bcb5-914968a9eb66" returned: 0 in 0.650s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-quobyte-46582a85-41e1-47d3-bcb5-914968a9eb66" released by "delete_volume" :: held 1.465s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Created reservations ['cfbae340-fa85-46b6-9d56-73c5af7ab41e', '8e8ed9f5-1297-4c53-8f0c-7eda59ef714b', 'b322e9be-6cfa-429e-8662-4d682ca64186', '7d1237be-d0f3-4037-ba54-a040ba681f11'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:16 devstack sudo[110076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:38:16 devstack sudo[110076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:16 devstack sudo[110072]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f511976b-7f80-455d-9a7e-f9c51d9b7960_x6nscp_sdevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1841686537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0799cc0-993b-470b-b034-d9906dcb54b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16001fca3124bd38d724926a6d98d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:38:11Z,use_quota=True,user_id='f4f310e9b85b4dc9822878838eed9232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f323370-b95c-4f12-b9d0-1580e41318c7),volume_type_id=6f323370-b95c-4f12-b9d0-1580e41318c7)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Creating volume c0799cc0-993b-470b-b034-d9906dcb54b8 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:38:16 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:16 devstack sudo[110081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 1073741824 Jun 28 14:38:16 devstack sudo[110081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:16 devstack sudo[110076]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.662s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:38:16 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Deleted volume successfully. Jun 28 14:38:16 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-aa8c6718-43ef-4c57-a0c3-8c8f23b51341 tempest-VolumesSnapshotTestJSON-1711042781 None] Lock "cinder-46582a85-41e1-47d3-bcb5-914968a9eb66-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:38:17 devstack sudo[110081]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 1073741824" returned: 0 in 0.836s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:17 devstack sudo[110088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 Jun 28 14:38:17 devstack sudo[110088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:17 devstack sudo[110088]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8" returned: 0 in 0.678s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:17 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:38:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:38:17 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Attempting download of f511976b-7f80-455d-9a7e-f9c51d9b7960 ((None, [{'url': 'file:///opt/stack/data/glance/images/f511976b-7f80-455d-9a7e-f9c51d9b7960', 'metadata': {}}])) to volume c0799cc0-993b-470b-b034-d9906dcb54b8. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 28 14:38:18 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b336b2ac-304e-47e5-b937-f66632a38fdc]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f511976b-7f80-455d-9a7e-f9c51d9b7960__w22h9y1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:18 devstack sudo[110093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f511976b-7f80-455d-9a7e-f9c51d9b7960__w22h9y1 Jun 28 14:38:18 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:18 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f511976b-7f80-455d-9a7e-f9c51d9b7960__w22h9y1" returned: 0 in 0.785s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f511976b-7f80-455d-9a7e-f9c51d9b7960__w22h9y1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:18 devstack sudo[110097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f511976b-7f80-455d-9a7e-f9c51d9b7960__w22h9y1 Jun 28 14:38:18 devstack sudo[110097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:19 devstack sudo[110097]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f511976b-7f80-455d-9a7e-f9c51d9b7960__w22h9y1" returned: 1 in 0.835s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f511976b-7f80-455d-9a7e-f9c51d9b7960__w22h9y1' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:38:19 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eeb9ee-2eb2-44b5-be25-9374a0642017]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f511976b-7f80-455d-9a7e-f9c51d9b7960_x6nscp_sdevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:19 devstack sudo[110103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f511976b-7f80-455d-9a7e-f9c51d9b7960_x6nscp_sdevstack@QuobyteHD Jun 28 14:38:19 devstack sudo[110103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:20 devstack sudo[110103]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f511976b-7f80-455d-9a7e-f9c51d9b7960_x6nscp_sdevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:20 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] f511976b-7f80-455d-9a7e-f9c51d9b7960 was qcow2, converting to raw {{(pid=93561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 28 14:38:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f511976b-7f80-455d-9a7e-f9c51d9b7960_x6nscp_sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:20 devstack sudo[110111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f511976b-7f80-455d-9a7e-f9c51d9b7960_x6nscp_sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 Jun 28 14:38:20 devstack sudo[110111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:22 devstack sudo[110111]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f511976b-7f80-455d-9a7e-f9c51d9b7960_x6nscp_sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8" returned: 0 in 1.944s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:22 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f511976b-7f80-455d-9a7e-f9c51d9b7960_x6nscp_sdevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:38:22 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Converted 112.00 MB image at 57.58 MB/s Jun 28 14:38:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:22 devstack sudo[110124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 1G Jun 28 14:38:22 devstack sudo[110124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:23 devstack sudo[110124]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 1G" returned: 0 in 0.773s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:23 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8148dc-9d12-4a61-bca5-8ada99e594fc]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:23 devstack sudo[110129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 Jun 28 14:38:23 devstack sudo[110129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:24 devstack sudo[110129]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8" returned: 0 in 0.829s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:24 devstack sudo[110133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 Jun 28 14:38:24 devstack sudo[110133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:24 devstack sudo[110133]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8" returned: 1 in 0.762s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:38:24 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Downloaded image f511976b-7f80-455d-9a7e-f9c51d9b7960 ((None, [{'url': 'file:///opt/stack/data/glance/images/f511976b-7f80-455d-9a7e-f9c51d9b7960', 'metadata': {}}])) to volume c0799cc0-993b-470b-b034-d9906dcb54b8 successfully. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 28 14:38:24 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Temporary image f511976b-7f80-455d-9a7e-f9c51d9b7960 for user f4f310e9b85b4dc9822878838eed9232 is deleted. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 28 14:38:24 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Marking volume c0799cc0-993b-470b-b034-d9906dcb54b8 as bootable. {{(pid=93561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 28 14:38:24 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Copying metadata from image f511976b-7f80-455d-9a7e-f9c51d9b7960 to c0799cc0-993b-470b-b034-d9906dcb54b8. {{(pid=93561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 28 14:38:24 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Creating volume glance metadata for volume c0799cc0-993b-470b-b034-d9906dcb54b8 backed by image f511976b-7f80-455d-9a7e-f9c51d9b7960 with: {'image_id': 'f511976b-7f80-455d-9a7e-f9c51d9b7960', 'image_name': 'tempest-scenario-img--226574380', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 28 14:38:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c5ffa5-51a7-4ac2-828c-704703a83f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0799cc0-993b-470b-b034-d9906dcb54b8', 'volume_size': 1, 'image_id': 'f511976b-7f80-455d-9a7e-f9c51d9b7960', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f511976b-7f80-455d-9a7e-f9c51d9b7960', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--226574380', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e16001fca3124bd38d724926a6d98d5b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f511976b-7f80-455d-9a7e-f9c51d9b7960', 'created_at': datetime.datetime(2026, 6, 28, 12, 38, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 38, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f511976b-7f80-455d-9a7e-f9c51d9b7960/file', 'properties': {}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d7f8ac-3b5b-4944-affc-ed05ab235514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:24 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Volume volume-c0799cc0-993b-470b-b034-d9906dcb54b8 (c0799cc0-993b-470b-b034-d9906dcb54b8): created successfully Jun 28 14:38:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d7f8ac-3b5b-4944-affc-ed05ab235514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Flow 'volume_create_manager' (6dcb1488-c77a-45ca-8a14-dbc80ced8b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:38:24 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-70174dca-a785-4005-a628-5eb4e6ffce21 tempest-TestInstancesWithCinderVolumes-1137798716 None] Created volume successfully. Jun 28 14:38:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-3dc8cf02-abd4-4e76-b8f1-961c11dd647a req-46a9a433-ba2c-4b79-9423-f1f27f16a601 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:38:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-3dc8cf02-abd4-4e76-b8f1-961c11dd647a req-46a9a433-ba2c-4b79-9423-f1f27f16a601 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:38:34 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2931220e-695f-466a-95f1-0ffd09cfd84e]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-3dc8cf02-abd4-4e76-b8f1-961c11dd647a req-46a9a433-ba2c-4b79-9423-f1f27f16a601 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:34 devstack sudo[110152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 Jun 28 14:38:34 devstack sudo[110152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:34 devstack sudo[110152]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-3dc8cf02-abd4-4e76-b8f1-961c11dd647a req-46a9a433-ba2c-4b79-9423-f1f27f16a601 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8" returned: 0 in 0.851s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-3dc8cf02-abd4-4e76-b8f1-961c11dd647a req-46a9a433-ba2c-4b79-9423-f1f27f16a601 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:35 devstack sudo[110157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 Jun 28 14:38:35 devstack sudo[110157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:35 devstack sudo[110157]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-3dc8cf02-abd4-4e76-b8f1-961c11dd647a req-46a9a433-ba2c-4b79-9423-f1f27f16a601 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8" returned: 1 in 0.912s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-3dc8cf02-abd4-4e76-b8f1-961c11dd647a req-46a9a433-ba2c-4b79-9423-f1f27f16a601 tempest-TestInstancesWithCinderVolumes-1137798716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:38:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-3dc8cf02-abd4-4e76-b8f1-961c11dd647a req-46a9a433-ba2c-4b79-9423-f1f27f16a601 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.830s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:38:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-3dc8cf02-abd4-4e76-b8f1-961c11dd647a req-46a9a433-ba2c-4b79-9423-f1f27f16a601 tempest-TestInstancesWithCinderVolumes-1137798716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-c0799cc0-993b-470b-b034-d9906dcb54b8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2911c215-07a0-4f37-807e-610203e9c614', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:38:35 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-3dc8cf02-abd4-4e76-b8f1-961c11dd647a req-46a9a433-ba2c-4b79-9423-f1f27f16a601 tempest-TestInstancesWithCinderVolumes-1137798716 None] attachment_update completed successfully. Jun 28 14:38:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:38:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:38:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:38:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:38:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:38:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:38:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:37 devstack sudo[110162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:38:37 devstack sudo[110162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:38 devstack sudo[110162]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.818s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:38:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:38:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 28 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:38:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=60,cinder:INSERT=22,cinder:UPDATE=58,cinder:DELETE=8 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Flow 'volume_create_manager' (a67750ed-fa43-41b2-8dd2-2c0423c2293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b86ca1-90f6-4a4d-9c67-7e957ea77c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b86ca1-90f6-4a4d-9c67-7e957ea77c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1448896866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f3d50a41dd4d79bea9333d9df63417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:38:44Z,use_quota=True,user_id='0bb73551859d4ae7842cca4e8f3cebff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd9b0c5-aea5-4aae-99bf-858ec7acda8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd9b0c5-aea5-4aae-99bf-858ec7acda8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae197dc-4e3b-4477-9012-bb8caccf3192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG cinder.image.glance [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Creating Keystone auth plugin from conf {{(pid=93561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae197dc-4e3b-4477-9012-bb8caccf3192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9', 'volume_name': 'volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9', 'volume_size': 1, 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e2aafa849d4b7590b8e84dddedb04b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'created_at': datetime.datetime(2026, 6, 28, 12, 14, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 14, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331b919b-e955-488f-bb1e-39a18409ba5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331b919b-e955-488f-bb1e-39a18409ba5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe5bbd3-8a01-419a-bdc1-e2af7c20645d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:44 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Volume f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9', 'volume_size': 1, 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e2aafa849d4b7590b8e84dddedb04b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'created_at': datetime.datetime(2026, 6, 28, 12, 14, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 14, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Trying to clone f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 from image dfdfa247-b97d-4fd5-928f-a01fae72e0ac at location (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]). {{(pid=93561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_cdnseuy6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 28 14:38:44 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Image download 20.69 MB at 20.69 MB/s Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f00e188-6b8a-4e45-9439-9600f6bd737a]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_cdnseuy6devstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:45 devstack sudo[110662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_cdnseuy6devstack@QuobyteHD Jun 28 14:38:45 devstack sudo[110662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:45 devstack sudo[110662]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_cdnseuy6devstack@QuobyteHD" returned: 0 in 0.752s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:45 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Temporary image dfdfa247-b97d-4fd5-928f-a01fae72e0ac is fetched for user 0bb73551859d4ae7842cca4e8f3cebff. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 28 14:38:45 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce907415-a9d4-41e2-b0fa-d99b342878ef]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_cdnseuy6devstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:45 devstack sudo[110667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_cdnseuy6devstack@QuobyteHD Jun 28 14:38:45 devstack sudo[110667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:46 devstack sudo[110667]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_cdnseuy6devstack@QuobyteHD" returned: 0 in 0.795s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:38:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:38:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1448896866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f3d50a41dd4d79bea9333d9df63417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:38:44Z,use_quota=True,user_id='0bb73551859d4ae7842cca4e8f3cebff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:38:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Creating volume f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:38:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:38:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:38:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:38:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:38:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:38:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:38:46 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:38:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:46 devstack sudo[110676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 1073741824 Jun 28 14:38:46 devstack sudo[110676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:47 devstack sudo[110676]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 1073741824" returned: 0 in 0.926s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:47 devstack sudo[110682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 Jun 28 14:38:47 devstack sudo[110682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:48 devstack sudo[110682]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9" returned: 0 in 0.682s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:38:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:38:48 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Attempting download of dfdfa247-b97d-4fd5-928f-a01fae72e0ac ((None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}])) to volume f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 28 14:38:48 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[072796cf-e21f-46b2-8f20-d2c9365240ef]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_v89gfuje {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:48 devstack sudo[110685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_v89gfuje Jun 28 14:38:48 devstack sudo[110685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:49 devstack sudo[110685]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_v89gfuje" returned: 0 in 0.833s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_v89gfuje {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:49 devstack sudo[110689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_v89gfuje Jun 28 14:38:49 devstack sudo[110689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:50 devstack sudo[110689]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_v89gfuje" returned: 1 in 0.901s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_v89gfuje' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:38:50 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd85e63-3e09-4f0f-ac76-5bd605b9ea26]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_cdnseuy6devstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:50 devstack sudo[110695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_cdnseuy6devstack@QuobyteHD Jun 28 14:38:50 devstack sudo[110695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:51 devstack sudo[110695]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_cdnseuy6devstack@QuobyteHD" returned: 0 in 0.890s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:51 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] dfdfa247-b97d-4fd5-928f-a01fae72e0ac was qcow2, converting to raw {{(pid=93561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 28 14:38:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_cdnseuy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:51 devstack sudo[110701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_cdnseuy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 Jun 28 14:38:51 devstack sudo[110701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:53 devstack sudo[110701]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_cdnseuy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9" returned: 0 in 2.258s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:53 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dfdfa247-b97d-4fd5-928f-a01fae72e0ac_cdnseuy6devstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:38:53 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Converted 112.00 MB image at 49.57 MB/s Jun 28 14:38:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:53 devstack sudo[110709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 1G Jun 28 14:38:53 devstack sudo[110709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:54 devstack sudo[110709]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 1G" returned: 0 in 0.820s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:54 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9ca706-0c28-4aea-96f5-2ca9e4870237]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:38:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:54 devstack sudo[110715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 Jun 28 14:38:54 devstack sudo[110715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:54 devstack sudo[110715]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9" returned: 0 in 0.763s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:38:55 devstack sudo[110719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 Jun 28 14:38:55 devstack sudo[110719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:38:55 devstack sudo[110719]: pam_unix(sudo:session): session closed for user root Jun 28 14:38:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9" returned: 1 in 0.763s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:38:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:38:55 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Downloaded image dfdfa247-b97d-4fd5-928f-a01fae72e0ac ((None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}])) to volume f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 successfully. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 28 14:38:55 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Temporary image dfdfa247-b97d-4fd5-928f-a01fae72e0ac for user 0bb73551859d4ae7842cca4e8f3cebff is deleted. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 28 14:38:55 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Marking volume f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 as bootable. {{(pid=93561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 28 14:38:55 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Copying metadata from image dfdfa247-b97d-4fd5-928f-a01fae72e0ac to f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9. {{(pid=93561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 28 14:38:55 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Creating volume glance metadata for volume f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 backed by image dfdfa247-b97d-4fd5-928f-a01fae72e0ac with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 28 14:38:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe5bbd3-8a01-419a-bdc1-e2af7c20645d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9', 'volume_size': 1, 'image_id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e2aafa849d4b7590b8e84dddedb04b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfdfa247-b97d-4fd5-928f-a01fae72e0ac', 'created_at': datetime.datetime(2026, 6, 28, 12, 14, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 14, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfdfa247-b97d-4fd5-928f-a01fae72e0ac/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f977cfde-8000-444b-b5c9-5f3b7fc2497d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:38:55 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Volume volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 (f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9): created successfully Jun 28 14:38:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f977cfde-8000-444b-b5c9-5f3b7fc2497d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:38:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Flow 'volume_create_manager' (a67750ed-fa43-41b2-8dd2-2c0423c2293a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:38:55 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-11127826-840c-4e5a-a7ca-a24e850955f2 tempest-TestShelveInstance-1746471476 None] Created volume successfully. Jun 28 14:39:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-73ea19d3-e6e2-4a9a-8fbc-7d3c73e9512b req-25e16880-3154-4c7e-8416-60a7e53afaeb tempest-TestShelveInstance-1746471476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:39:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-73ea19d3-e6e2-4a9a-8fbc-7d3c73e9512b req-25e16880-3154-4c7e-8416-60a7e53afaeb tempest-TestShelveInstance-1746471476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:39:03 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0af555d-e367-4eb9-a999-5fdc345a7be3]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:39:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-73ea19d3-e6e2-4a9a-8fbc-7d3c73e9512b req-25e16880-3154-4c7e-8416-60a7e53afaeb tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:03 devstack sudo[110815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 Jun 28 14:39:03 devstack sudo[110815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:03 devstack sudo[110815]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-73ea19d3-e6e2-4a9a-8fbc-7d3c73e9512b req-25e16880-3154-4c7e-8416-60a7e53afaeb tempest-TestShelveInstance-1746471476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9" returned: 0 in 0.774s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-73ea19d3-e6e2-4a9a-8fbc-7d3c73e9512b req-25e16880-3154-4c7e-8416-60a7e53afaeb tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:04 devstack sudo[110820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 Jun 28 14:39:04 devstack sudo[110820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:04 devstack sudo[110820]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-73ea19d3-e6e2-4a9a-8fbc-7d3c73e9512b req-25e16880-3154-4c7e-8416-60a7e53afaeb tempest-TestShelveInstance-1746471476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9" returned: 1 in 0.752s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-73ea19d3-e6e2-4a9a-8fbc-7d3c73e9512b req-25e16880-3154-4c7e-8416-60a7e53afaeb tempest-TestShelveInstance-1746471476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:39:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-73ea19d3-e6e2-4a9a-8fbc-7d3c73e9512b req-25e16880-3154-4c7e-8416-60a7e53afaeb tempest-TestShelveInstance-1746471476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.581s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:39:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-73ea19d3-e6e2-4a9a-8fbc-7d3c73e9512b req-25e16880-3154-4c7e-8416-60a7e53afaeb tempest-TestShelveInstance-1746471476 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c22ee099-e4bd-47be-9a9b-bc8ef4e7b091', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:39:04 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-73ea19d3-e6e2-4a9a-8fbc-7d3c73e9512b req-25e16880-3154-4c7e-8416-60a7e53afaeb tempest-TestShelveInstance-1746471476 None] attachment_update completed successfully. Jun 28 14:39:14 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:INSERT=17,cinder:UPDATE=48,cinder:SELECT=50,cinder:DELETE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:39:14 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=12,cinder:INSERT=10,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:39:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-dacb879d-e1b5-458e-b5d7-526e70803ac0 req-21300911-96a1-424f-b0e8-f541878342c1 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:39:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-dacb879d-e1b5-458e-b5d7-526e70803ac0 req-21300911-96a1-424f-b0e8-f541878342c1 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:39:17 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d521712a-f6ac-45a0-bb52-e7b72938dd80]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:39:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-dacb879d-e1b5-458e-b5d7-526e70803ac0 req-21300911-96a1-424f-b0e8-f541878342c1 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:17 devstack sudo[110929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb Jun 28 14:39:17 devstack sudo[110929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:18 devstack sudo[110929]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-dacb879d-e1b5-458e-b5d7-526e70803ac0 req-21300911-96a1-424f-b0e8-f541878342c1 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb" returned: 0 in 0.770s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-dacb879d-e1b5-458e-b5d7-526e70803ac0 req-21300911-96a1-424f-b0e8-f541878342c1 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.790s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:39:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-dacb879d-e1b5-458e-b5d7-526e70803ac0 req-21300911-96a1-424f-b0e8-f541878342c1 tempest-TestInstancesWithCinderVolumes-1137798716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f85e044-413a-4481-bb47-ab950e36baa8', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:39:18 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-dacb879d-e1b5-458e-b5d7-526e70803ac0 req-21300911-96a1-424f-b0e8-f541878342c1 tempest-TestInstancesWithCinderVolumes-1137798716 None] attachment_update completed successfully. Jun 28 14:39:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-7867af51-0e63-445c-9d7a-c713d975cca5 req-f3a2857d-cdff-4dce-87c6-22b6370a5ea2 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:39:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-7867af51-0e63-445c-9d7a-c713d975cca5 req-f3a2857d-cdff-4dce-87c6-22b6370a5ea2 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:39:25 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dc137c-ff91-41ac-a851-7178c36a5711]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:39:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-7867af51-0e63-445c-9d7a-c713d975cca5 req-f3a2857d-cdff-4dce-87c6-22b6370a5ea2 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8138604c-2442-45de-a180-248d02d7cf9d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:26 devstack sudo[110989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8138604c-2442-45de-a180-248d02d7cf9d Jun 28 14:39:26 devstack sudo[110989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:26 devstack sudo[110989]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-7867af51-0e63-445c-9d7a-c713d975cca5 req-f3a2857d-cdff-4dce-87c6-22b6370a5ea2 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8138604c-2442-45de-a180-248d02d7cf9d" returned: 0 in 0.825s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-7867af51-0e63-445c-9d7a-c713d975cca5 req-f3a2857d-cdff-4dce-87c6-22b6370a5ea2 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.861s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:39:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-7867af51-0e63-445c-9d7a-c713d975cca5 req-f3a2857d-cdff-4dce-87c6-22b6370a5ea2 tempest-TestInstancesWithCinderVolumes-1137798716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-8138604c-2442-45de-a180-248d02d7cf9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af40391f-0512-4e5b-b175-407351b4f12d', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:39:26 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-7867af51-0e63-445c-9d7a-c713d975cca5 req-f3a2857d-cdff-4dce-87c6-22b6370a5ea2 tempest-TestInstancesWithCinderVolumes-1137798716 None] attachment_update completed successfully. Jun 28 14:39:35 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-6d485839-21ae-4bca-b9e4-70d3954b4e26 req-fdac81fb-dc66-418d-9979-0e30a5777742 tempest-TestInstancesWithCinderVolumes-1137798716 None] Terminate volume connection completed successfully. Jun 28 14:39:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-6d485839-21ae-4bca-b9e4-70d3954b4e26 req-fdac81fb-dc66-418d-9979-0e30a5777742 tempest-TestInstancesWithCinderVolumes-1137798716 None] Deleting attachment 7f85e044-413a-4481-bb47-ab950e36baa8. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:39:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "cinder-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:39:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "cinder-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:39:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "cinder-quobyte-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:39:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "cinder-quobyte-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:39:37 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c6883c-c57a-41a7-af4a-6546e1a454e7]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:39:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:37 devstack sudo[111044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb Jun 28 14:39:37 devstack sudo[111044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:39:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:39:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:39:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:39:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:39:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:39:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:37 devstack sudo[111051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:39:37 devstack sudo[111051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:38 devstack sudo[111044]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb" returned: 0 in 0.884s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:38 devstack sudo[111055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb Jun 28 14:39:38 devstack sudo[111055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:38 devstack sudo[111051]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.999s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:39:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:39:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 28 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:39:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:39:39 devstack sudo[111055]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb" returned: 0 in 1.059s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "cinder-quobyte-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb" released by "delete_volume" :: held 1.985s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:39:39 devstack cinder-volume[93561]: WARNING cinder.quota [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-501037374-1384351152 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-501037374-1384351152, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:39:39 devstack cinder-volume[93561]: WARNING cinder.quota [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-501037374-1384351152 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-501037374-1384351152, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:39:39 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Created reservations ['7a5b077f-247c-46db-865a-9d56e2287700', '7bd1d506-d500-4992-8fe9-05a0b664f1d4', '4268bad0-8d47-4110-bda8-29781d0f53bb', '4cd10f2f-00bc-4f6b-8443-57a09f728e0d'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:39:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:39:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:39:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:39:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:39:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:39:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:39 devstack sudo[111100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:39:39 devstack sudo[111100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:39 devstack sudo[111100]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.650s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:39 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:39:39 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Deleted volume successfully. Jun 28 14:39:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fb41a49a-77e9-4c92-9888-fffa41c24d19 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "cinder-b3a9e31d-9fa3-4e85-8277-ddaa8f8420eb-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:39:42 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-c27d89af-cf58-4e68-bf19-69b5142df6b2 req-1b817a90-20d4-4450-9c35-dda65d91d4c0 tempest-TestInstancesWithCinderVolumes-1137798716 None] Terminate volume connection completed successfully. Jun 28 14:39:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-c27d89af-cf58-4e68-bf19-69b5142df6b2 req-1b817a90-20d4-4450-9c35-dda65d91d4c0 tempest-TestInstancesWithCinderVolumes-1137798716 None] Deleting attachment af40391f-0512-4e5b-b175-407351b4f12d. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:39:42 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-288155f3-d0a2-49e6-8b28-b30bd0de46fa req-ee145f46-f95f-40e4-bbda-608ba1d4de1f tempest-TestShelveInstance-1746471476 None] Terminate volume connection completed successfully. Jun 28 14:39:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-288155f3-d0a2-49e6-8b28-b30bd0de46fa req-ee145f46-f95f-40e4-bbda-608ba1d4de1f tempest-TestShelveInstance-1746471476 None] Deleting attachment c22ee099-e4bd-47be-9a9b-bc8ef4e7b091. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:39:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "cinder-8138604c-2442-45de-a180-248d02d7cf9d-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:39:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "cinder-8138604c-2442-45de-a180-248d02d7cf9d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:39:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "cinder-quobyte-8138604c-2442-45de-a180-248d02d7cf9d" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:39:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "cinder-quobyte-8138604c-2442-45de-a180-248d02d7cf9d" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:39:43 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8126d438-4651-4ed0-99b3-53d160afd1b2]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:39:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8138604c-2442-45de-a180-248d02d7cf9d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:44 devstack sudo[111170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8138604c-2442-45de-a180-248d02d7cf9d Jun 28 14:39:44 devstack sudo[111170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:44 devstack sudo[111170]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8138604c-2442-45de-a180-248d02d7cf9d" returned: 0 in 0.914s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8138604c-2442-45de-a180-248d02d7cf9d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:44 devstack sudo[111176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8138604c-2442-45de-a180-248d02d7cf9d Jun 28 14:39:44 devstack sudo[111176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:45 devstack sudo[111176]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8138604c-2442-45de-a180-248d02d7cf9d" returned: 0 in 0.812s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:45 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "cinder-quobyte-8138604c-2442-45de-a180-248d02d7cf9d" released by "delete_volume" :: held 1.780s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:39:45 devstack cinder-volume[93561]: WARNING cinder.quota [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1539598961-1261334890 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1539598961-1261334890, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:39:45 devstack cinder-volume[93561]: WARNING cinder.quota [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1539598961-1261334890 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1539598961-1261334890, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:39:45 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Created reservations ['f25af5d9-a2e3-4985-a93e-8302f48e9f5c', '383fe3b2-9b60-4787-8aab-38c89cbcb147', '0add2bad-b47a-4acd-a98b-2cc37a0dcfd7', 'e43e37ff-11bb-4888-8c65-bc5d07d12ef9'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:39:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:39:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:39:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:39:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:39:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:39:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:45 devstack sudo[111182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:39:45 devstack sudo[111182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:46 devstack sudo[111182]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.853s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:46 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:39:46 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Deleted volume successfully. Jun 28 14:39:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4734dd6c-a516-4ef5-b364-9d4b66194801 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "cinder-8138604c-2442-45de-a180-248d02d7cf9d-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:39:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-30f25c5a-b815-4ac3-9bc9-bb43e96c970c req-d8fc9334-3e92-48cb-80aa-8e517fab0bc4 tempest-TestShelveInstance-1746471476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:39:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-30f25c5a-b815-4ac3-9bc9-bb43e96c970c req-d8fc9334-3e92-48cb-80aa-8e517fab0bc4 tempest-TestShelveInstance-1746471476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:39:48 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[be624718-2f9a-40d2-ba71-f5242cbcba30]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:39:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-30f25c5a-b815-4ac3-9bc9-bb43e96c970c req-d8fc9334-3e92-48cb-80aa-8e517fab0bc4 tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:48 devstack sudo[111239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 Jun 28 14:39:48 devstack sudo[111239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:49 devstack sudo[111239]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-30f25c5a-b815-4ac3-9bc9-bb43e96c970c req-d8fc9334-3e92-48cb-80aa-8e517fab0bc4 tempest-TestShelveInstance-1746471476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9" returned: 0 in 0.821s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-30f25c5a-b815-4ac3-9bc9-bb43e96c970c req-d8fc9334-3e92-48cb-80aa-8e517fab0bc4 tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:49 devstack sudo[111245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 Jun 28 14:39:49 devstack sudo[111245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:49 devstack sudo[111245]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-30f25c5a-b815-4ac3-9bc9-bb43e96c970c req-d8fc9334-3e92-48cb-80aa-8e517fab0bc4 tempest-TestShelveInstance-1746471476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9" returned: 1 in 0.864s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-30f25c5a-b815-4ac3-9bc9-bb43e96c970c req-d8fc9334-3e92-48cb-80aa-8e517fab0bc4 tempest-TestShelveInstance-1746471476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:39:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-30f25c5a-b815-4ac3-9bc9-bb43e96c970c req-d8fc9334-3e92-48cb-80aa-8e517fab0bc4 tempest-TestShelveInstance-1746471476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.737s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:39:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-30f25c5a-b815-4ac3-9bc9-bb43e96c970c req-d8fc9334-3e92-48cb-80aa-8e517fab0bc4 tempest-TestShelveInstance-1746471476 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '092b6ad0-fbf6-46bb-88f9-2b39ec785557', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:39:49 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-30f25c5a-b815-4ac3-9bc9-bb43e96c970c req-d8fc9334-3e92-48cb-80aa-8e517fab0bc4 tempest-TestShelveInstance-1746471476 None] attachment_update completed successfully. Jun 28 14:39:50 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-8dd0def5-e695-46dc-8f30-f3e3aec41543 req-3c48fc56-9005-43c1-8d01-171cd1987d92 tempest-TestInstancesWithCinderVolumes-1137798716 None] Terminate volume connection completed successfully. Jun 28 14:39:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-8dd0def5-e695-46dc-8f30-f3e3aec41543 req-3c48fc56-9005-43c1-8d01-171cd1987d92 tempest-TestInstancesWithCinderVolumes-1137798716 None] Deleting attachment 2911c215-07a0-4f37-807e-610203e9c614. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:39:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "cinder-c0799cc0-993b-470b-b034-d9906dcb54b8-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:39:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "cinder-c0799cc0-993b-470b-b034-d9906dcb54b8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:39:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "cinder-quobyte-c0799cc0-993b-470b-b034-d9906dcb54b8" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:39:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "cinder-quobyte-c0799cc0-993b-470b-b034-d9906dcb54b8" acquired by "delete_volume" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:39:56 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[697fea38-ec84-47b1-b670-a128bac42d5c]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:39:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:56 devstack sudo[111255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 Jun 28 14:39:56 devstack sudo[111255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:57 devstack sudo[111255]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8" returned: 0 in 0.775s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:57 devstack sudo[111259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 Jun 28 14:39:57 devstack sudo[111259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:57 devstack sudo[111259]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8" returned: 1 in 0.781s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:39:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:58 devstack sudo[111265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8 Jun 28 14:39:58 devstack sudo[111265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:58 devstack sudo[111265]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-c0799cc0-993b-470b-b034-d9906dcb54b8" returned: 0 in 0.717s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:58 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "cinder-quobyte-c0799cc0-993b-470b-b034-d9906dcb54b8" released by "delete_volume" :: held 2.339s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:39:58 devstack cinder-volume[93561]: WARNING cinder.quota [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453443786-25365321 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453443786-25365321, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:39:58 devstack cinder-volume[93561]: WARNING cinder.quota [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453443786-25365321 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453443786-25365321, it is now deprecated. Please use the default quota class for default quota. Jun 28 14:39:58 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Created reservations ['878d4047-ae73-4af7-9da2-dd112ee89036', 'c4bacfc6-d164-4a3b-a782-3dd30ec8935c', '29263ec1-5bd5-4f46-a4ce-1a2b31f2a71f', '78223086-ed6c-403c-8bb3-15e3e36caa3c'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:39:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:39:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:39:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:39:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:39:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:39:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:39:58 devstack sudo[111334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:39:58 devstack sudo[111334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:39:59 devstack sudo[111334]: pam_unix(sudo:session): session closed for user root Jun 28 14:39:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.677s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:39:59 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:39:59 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Deleted volume successfully. Jun 28 14:39:59 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-72999855-9239-408e-a454-8602f706cfe8 tempest-TestInstancesWithCinderVolumes-1137798716 None] Lock "cinder-c0799cc0-993b-470b-b034-d9906dcb54b8-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:40:14 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=35,cinder:UPDATE=32,cinder:INSERT=7,cinder:DELETE=2 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:40:14 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=37,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Flow 'volume_create_manager' (de9b4c6d-3001-4241-845d-8e65e51b8fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd38db6a-8e77-4403-8124-ae4b8612259e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd38db6a-8e77-4403-8124-ae4b8612259e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-106781481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c1746d-16e2-45d7-bdab-c008d27645fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc63864b05f42f7b3b553df9204eda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:40:31Z,use_quota=True,user_id='fa0e4aef33cc442b9165d80b4c66c0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d90150-e677-43ad-808f-1897b1c3bdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d90150-e677-43ad-808f-1897b1c3bdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f723d242-c537-4e49-9b4c-76caedfe78fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f723d242-c537-4e49-9b4c-76caedfe78fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c1746d-16e2-45d7-bdab-c008d27645fe', 'volume_name': 'volume-73c1746d-16e2-45d7-bdab-c008d27645fe', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba2cdd4-9466-4d75-9921-84d580f8c696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba2cdd4-9466-4d75-9921-84d580f8c696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816dfb18-dfe0-428d-92e9-e899a3109dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:40:30 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Volume 73c1746d-16e2-45d7-bdab-c008d27645fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c1746d-16e2-45d7-bdab-c008d27645fe', 'volume_size': 1} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-106781481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c1746d-16e2-45d7-bdab-c008d27645fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc63864b05f42f7b3b553df9204eda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:40:31Z,use_quota=True,user_id='fa0e4aef33cc442b9165d80b4c66c0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Creating volume 73c1746d-16e2-45d7-bdab-c008d27645fe {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:40:30 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-73c1746d-16e2-45d7-bdab-c008d27645fe 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:40:30 devstack sudo[111789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-73c1746d-16e2-45d7-bdab-c008d27645fe 1073741824 Jun 28 14:40:30 devstack sudo[111789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Flow 'volume_create_manager' (8138cbde-6dca-4c4c-aa0b-45ef413f4cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:40:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a4e794-a0b9-4f58-8963-9a289ae1fd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:40:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a4e794-a0b9-4f58-8963-9a289ae1fd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1320693984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc63864b05f42f7b3b553df9204eda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:40:31Z,use_quota=True,user_id='fa0e4aef33cc442b9165d80b4c66c0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:40:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0117a91a-3153-4c84-8363-f77eaa979303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:40:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0117a91a-3153-4c84-8363-f77eaa979303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:40:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0323b7-9aff-4acf-9101-a13359b6ef6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:40:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0323b7-9aff-4acf-9101-a13359b6ef6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede', 'volume_name': 'volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:40:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad77fcdf-fbf7-44d5-a0d9-43949c8d9e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:40:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad77fcdf-fbf7-44d5-a0d9-43949c8d9e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:40:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3098cd-125f-4b50-a9b7-e1a10fb0579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:40:31 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Volume 8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede', 'volume_size': 1} Jun 28 14:40:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:40:31 devstack sudo[111789]: pam_unix(sudo:session): session closed for user root Jun 28 14:40:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-73c1746d-16e2-45d7-bdab-c008d27645fe 1073741824" returned: 0 in 0.893s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:40:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-73c1746d-16e2-45d7-bdab-c008d27645fe {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:40:31 devstack sudo[111795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-73c1746d-16e2-45d7-bdab-c008d27645fe Jun 28 14:40:31 devstack sudo[111795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:40:32 devstack sudo[111795]: pam_unix(sudo:session): session closed for user root Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-73c1746d-16e2-45d7-bdab-c008d27645fe" returned: 0 in 0.686s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.274s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1320693984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc63864b05f42f7b3b553df9204eda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:40:31Z,use_quota=True,user_id='fa0e4aef33cc442b9165d80b4c66c0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Creating volume 8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:40:32 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816dfb18-dfe0-428d-92e9-e899a3109dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c1746d-16e2-45d7-bdab-c008d27645fe', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a82444-b708-4863-9c4b-dfac13bf9146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:40:32 devstack sudo[111798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede 1073741824 Jun 28 14:40:32 devstack sudo[111798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:40:32 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Volume volume-73c1746d-16e2-45d7-bdab-c008d27645fe (73c1746d-16e2-45d7-bdab-c008d27645fe): created successfully Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a82444-b708-4863-9c4b-dfac13bf9146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:40:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Flow 'volume_create_manager' (de9b4c6d-3001-4241-845d-8e65e51b8fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:40:32 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-79f05442-c778-4ae5-8c73-3efcf333c04d tempest-TestServerVolumeAttachmentScenario-1170075083 None] Created volume successfully. Jun 28 14:40:33 devstack sudo[111798]: pam_unix(sudo:session): session closed for user root Jun 28 14:40:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede 1073741824" returned: 0 in 0.860s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:40:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:40:33 devstack sudo[111804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede Jun 28 14:40:33 devstack sudo[111804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:40:33 devstack sudo[111804]: pam_unix(sudo:session): session closed for user root Jun 28 14:40:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede" returned: 0 in 0.656s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:40:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:40:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:40:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3098cd-125f-4b50-a9b7-e1a10fb0579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:40:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69710507-101e-467d-a2b6-74e5b73b41f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:40:33 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Volume volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede (8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede): created successfully Jun 28 14:40:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69710507-101e-467d-a2b6-74e5b73b41f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:40:33 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Flow 'volume_create_manager' (8138cbde-6dca-4c4c-aa0b-45ef413f4cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:40:33 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-b9a8dd10-3616-419b-845c-c1684242bc51 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Created volume successfully. Jun 28 14:40:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:40:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:40:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:40:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:40:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:40:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:40:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:40:37 devstack sudo[111810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:40:37 devstack sudo[111810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:40:38 devstack sudo[111810]: pam_unix(sudo:session): session closed for user root Jun 28 14:40:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.697s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:40:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:40:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:40:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 28 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:40:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:40:43 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=6 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:40:43 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6,cinder:DELETE=2,cinder:INSERT=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:40:45 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-299ffbb9-f697-4f86-8448-6150d818e7d2 tempest-TestShelveInstance-1746471476 None] Terminate volume connection completed successfully. Jun 28 14:40:45 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-299ffbb9-f697-4f86-8448-6150d818e7d2 tempest-TestShelveInstance-1746471476 None] Deleting attachment 092b6ad0-fbf6-46bb-88f9-2b39ec785557. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:40:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Acquiring lock "cinder-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:40:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Lock "cinder-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:40:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Acquiring lock "cinder-quobyte-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:40:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Lock "cinder-quobyte-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:40:46 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea34a20-3a00-41ad-902c-ef1ff6ade185]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:40:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:40:46 devstack sudo[112004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 Jun 28 14:40:46 devstack sudo[112004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:40:47 devstack sudo[112004]: pam_unix(sudo:session): session closed for user root Jun 28 14:40:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9" returned: 0 in 0.879s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:40:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:40:47 devstack sudo[112010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 Jun 28 14:40:47 devstack sudo[112010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:40:48 devstack sudo[112010]: pam_unix(sudo:session): session closed for user root Jun 28 14:40:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9" returned: 1 in 0.851s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:40:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:40:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:40:48 devstack sudo[112015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9 Jun 28 14:40:48 devstack sudo[112015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:40:48 devstack sudo[112015]: pam_unix(sudo:session): session closed for user root Jun 28 14:40:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9" returned: 0 in 0.716s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:40:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Lock "cinder-quobyte-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9" released by "delete_volume" :: held 2.529s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:40:49 devstack cinder-volume[93561]: DEBUG cinder.quota [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Created reservations ['f45b819b-2a0b-4b4f-ade2-55cb5a6fc8e7', '05ed38cb-d4d0-4d2f-bd4d-15e7611b31fe', '125e4a97-bcf6-4f0b-ad80-eb4320442496', 'f60352ff-5cc1-4260-9e7e-75832cc0b434'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:40:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:40:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:40:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:40:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:40:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:40:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:40:49 devstack sudo[112018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:40:49 devstack sudo[112018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:40:50 devstack sudo[112018]: pam_unix(sudo:session): session closed for user root Jun 28 14:40:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.928s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:40:50 devstack cinder-volume[93561]: DEBUG cinder.manager [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:40:50 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Deleted volume successfully. Jun 28 14:40:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [req-e3f5dd27-25b0-4c99-8d03-446c9c127205 req-fa27a76e-7810-4092-8ec8-67213a90cb6e tempest-TestShelveInstance-1746471476 None] Lock "cinder-f2a6d8ae-6505-439f-b794-f7e1ddf9d8d9-delete_volume" released by "delete_volume" :: held 3.851s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:40:59 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:41:00 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:41:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-c32a8445-359e-4948-b9f6-b1efc8724d63 req-6efef083-37e0-401d-8d14-e62fc4d52178 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:41:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-c32a8445-359e-4948-b9f6-b1efc8724d63 req-6efef083-37e0-401d-8d14-e62fc4d52178 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:41:13 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1103eb6-ab7d-4922-9334-529696522cf1]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:41:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-c32a8445-359e-4948-b9f6-b1efc8724d63 req-6efef083-37e0-401d-8d14-e62fc4d52178 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-73c1746d-16e2-45d7-bdab-c008d27645fe {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:41:13 devstack sudo[112060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-73c1746d-16e2-45d7-bdab-c008d27645fe Jun 28 14:41:13 devstack sudo[112060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:41:14 devstack sudo[112060]: pam_unix(sudo:session): session closed for user root Jun 28 14:41:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-c32a8445-359e-4948-b9f6-b1efc8724d63 req-6efef083-37e0-401d-8d14-e62fc4d52178 tempest-TestServerVolumeAttachmentScenario-1170075083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-73c1746d-16e2-45d7-bdab-c008d27645fe" returned: 0 in 0.896s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:41:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-c32a8445-359e-4948-b9f6-b1efc8724d63 req-6efef083-37e0-401d-8d14-e62fc4d52178 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.916s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:41:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-c32a8445-359e-4948-b9f6-b1efc8724d63 req-6efef083-37e0-401d-8d14-e62fc4d52178 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-73c1746d-16e2-45d7-bdab-c008d27645fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5cb22faf-a426-4857-ade4-b145ff0c0b3c', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:41:14 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-c32a8445-359e-4948-b9f6-b1efc8724d63 req-6efef083-37e0-401d-8d14-e62fc4d52178 tempest-TestServerVolumeAttachmentScenario-1170075083 None] attachment_update completed successfully. Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Flow 'volume_create_manager' (361fb4d3-9b9e-499a-be78-6351c8933ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc9e5c8-9484-4cfe-847d-0210dcf31303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc9e5c8-9484-4cfe-847d-0210dcf31303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1449019374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc56c0c1-8e33-49a4-810e-51799bdfcaf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcfc5573e1e4bb4bdea1c37537b14d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:41:22Z,use_quota=True,user_id='14d7073d7a08441aa26ce264544ab58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c357cbab-afb8-4428-9ec2-ab9acbba9122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c357cbab-afb8-4428-9ec2-ab9acbba9122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6ced32-b11d-4ebf-84b6-7b8d762ae05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6ced32-b11d-4ebf-84b6-7b8d762ae05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc56c0c1-8e33-49a4-810e-51799bdfcaf6', 'volume_name': 'volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc49c7ca-3528-4074-87d9-87e00469c9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc49c7ca-3528-4074-87d9-87e00469c9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae4cefb-2684-4a96-8fc1-b70c735ef94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:41:22 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Volume cc56c0c1-8e33-49a4-810e-51799bdfcaf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6', 'volume_size': 1} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1449019374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc56c0c1-8e33-49a4-810e-51799bdfcaf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcfc5573e1e4bb4bdea1c37537b14d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:41:22Z,use_quota=True,user_id='14d7073d7a08441aa26ce264544ab58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Creating volume cc56c0c1-8e33-49a4-810e-51799bdfcaf6 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:41:22 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:41:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:41:22 devstack sudo[112468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 1073741824 Jun 28 14:41:22 devstack sudo[112468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:41:23 devstack sudo[112468]: pam_unix(sudo:session): session closed for user root Jun 28 14:41:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 1073741824" returned: 0 in 0.940s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:41:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:41:23 devstack sudo[112480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 Jun 28 14:41:23 devstack sudo[112480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:41:23 devstack sudo[112480]: pam_unix(sudo:session): session closed for user root Jun 28 14:41:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6" returned: 0 in 0.640s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:41:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:41:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:41:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae4cefb-2684-4a96-8fc1-b70c735ef94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:41:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4b6a10-2473-4959-8351-54a4eca272c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:41:23 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Volume volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 (cc56c0c1-8e33-49a4-810e-51799bdfcaf6): created successfully Jun 28 14:41:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4b6a10-2473-4959-8351-54a4eca272c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:41:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Flow 'volume_create_manager' (361fb4d3-9b9e-499a-be78-6351c8933ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:41:23 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-2474545d-689a-4f22-b390-8a383d68c73d tempest-TestStampPattern-2036258036 None] Created volume successfully. Jun 28 14:41:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-effc4ca2-471f-4053-8e32-73599134cfdc req-37ffd54c-474d-4e44-87f8-f49adeb97cdf tempest-TestServerVolumeAttachmentScenario-1170075083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:41:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-effc4ca2-471f-4053-8e32-73599134cfdc req-37ffd54c-474d-4e44-87f8-f49adeb97cdf tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:41:25 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98fffae-c764-43ab-9436-0d9565651674]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:41:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-effc4ca2-471f-4053-8e32-73599134cfdc req-37ffd54c-474d-4e44-87f8-f49adeb97cdf tempest-TestServerVolumeAttachmentScenario-1170075083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:41:25 devstack sudo[112491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede Jun 28 14:41:25 devstack sudo[112491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:41:26 devstack sudo[112491]: pam_unix(sudo:session): session closed for user root Jun 28 14:41:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-effc4ca2-471f-4053-8e32-73599134cfdc req-37ffd54c-474d-4e44-87f8-f49adeb97cdf tempest-TestServerVolumeAttachmentScenario-1170075083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede" returned: 0 in 0.784s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:41:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-effc4ca2-471f-4053-8e32-73599134cfdc req-37ffd54c-474d-4e44-87f8-f49adeb97cdf tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.802s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:41:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-effc4ca2-471f-4053-8e32-73599134cfdc req-37ffd54c-474d-4e44-87f8-f49adeb97cdf tempest-TestServerVolumeAttachmentScenario-1170075083 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b81dd24a-f166-48ea-a944-b6ef2aebae9c', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:41:26 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-effc4ca2-471f-4053-8e32-73599134cfdc req-37ffd54c-474d-4e44-87f8-f49adeb97cdf tempest-TestServerVolumeAttachmentScenario-1170075083 None] attachment_update completed successfully. Jun 28 14:41:32 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-4d595022-a4f5-4072-8f9e-65a5f5c0cd02 req-4abd645d-90a2-40e6-9bec-f47b2e3ccd4c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Terminate volume connection completed successfully. Jun 28 14:41:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-4d595022-a4f5-4072-8f9e-65a5f5c0cd02 req-4abd645d-90a2-40e6-9bec-f47b2e3ccd4c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Deleting attachment b81dd24a-f166-48ea-a944-b6ef2aebae9c. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:41:36 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:41:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:41:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:41:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:41:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:41:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:41:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:41:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:41:37 devstack sudo[112639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:41:37 devstack sudo[112639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:41:38 devstack sudo[112639]: pam_unix(sudo:session): session closed for user root Jun 28 14:41:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.802s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:41:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:41:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:41:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 28 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:41:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:41:38 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-e66d5199-e023-462d-a454-4a2e97cc1da1 req-c188ad5a-9797-4817-a464-07449fe15c5a tempest-TestServerVolumeAttachmentScenario-1170075083 None] Terminate volume connection completed successfully. Jun 28 14:41:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e66d5199-e023-462d-a454-4a2e97cc1da1 req-c188ad5a-9797-4817-a464-07449fe15c5a tempest-TestServerVolumeAttachmentScenario-1170075083 None] Deleting attachment 5cb22faf-a426-4857-ade4-b145ff0c0b3c. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:41:48 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:41:48 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:41:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Acquiring lock "cinder-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:41:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "cinder-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:41:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Acquiring lock "cinder-quobyte-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:41:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "cinder-quobyte-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:41:49 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb4d247-7180-40a2-94bb-061dba972053]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:41:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:41:49 devstack sudo[112743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede Jun 28 14:41:49 devstack sudo[112743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:41:50 devstack sudo[112743]: pam_unix(sudo:session): session closed for user root Jun 28 14:41:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede" returned: 0 in 0.742s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:41:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:41:50 devstack sudo[112748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede Jun 28 14:41:50 devstack sudo[112748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:41:50 devstack sudo[112748]: pam_unix(sudo:session): session closed for user root Jun 28 14:41:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede" returned: 0 in 0.644s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:41:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "cinder-quobyte-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede" released by "delete_volume" :: held 1.429s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:41:50 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Created reservations ['34c86ed0-c9e8-4b61-8788-58aaf9b36c74', '88e8dcf1-b284-4853-a7ae-acdf1b2522da', 'de9b7671-631c-436d-adb5-7d53cf983065', 'a80f5081-5311-4ee1-95aa-d446e3035b97'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:41:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:41:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:41:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:41:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:41:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:41:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:41:50 devstack sudo[112752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:41:50 devstack sudo[112752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:41:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Acquiring lock "cinder-73c1746d-16e2-45d7-bdab-c008d27645fe-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:41:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "cinder-73c1746d-16e2-45d7-bdab-c008d27645fe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:41:51 devstack sudo[112752]: pam_unix(sudo:session): session closed for user root Jun 28 14:41:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.644s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:41:51 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:41:51 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Deleted volume successfully. Jun 28 14:41:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Acquiring lock "cinder-quobyte-73c1746d-16e2-45d7-bdab-c008d27645fe" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:41:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-642c721f-737e-462d-b45f-ccaa18f6e71c tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "cinder-8cfcf4bf-ed9a-4270-8cfd-70fc66d5cede-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:41:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "cinder-quobyte-73c1746d-16e2-45d7-bdab-c008d27645fe" acquired by "delete_volume" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:41:51 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d629bef-8d61-4b9d-929c-c1ff70c95e2b]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:41:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-73c1746d-16e2-45d7-bdab-c008d27645fe {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:41:51 devstack sudo[112755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-73c1746d-16e2-45d7-bdab-c008d27645fe Jun 28 14:41:51 devstack sudo[112755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:41:52 devstack sudo[112755]: pam_unix(sudo:session): session closed for user root Jun 28 14:41:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-73c1746d-16e2-45d7-bdab-c008d27645fe" returned: 0 in 0.746s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:41:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-73c1746d-16e2-45d7-bdab-c008d27645fe {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:41:52 devstack sudo[112760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-73c1746d-16e2-45d7-bdab-c008d27645fe Jun 28 14:41:52 devstack sudo[112760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:41:52 devstack sudo[112760]: pam_unix(sudo:session): session closed for user root Jun 28 14:41:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-73c1746d-16e2-45d7-bdab-c008d27645fe" returned: 0 in 0.639s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:41:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "cinder-quobyte-73c1746d-16e2-45d7-bdab-c008d27645fe" released by "delete_volume" :: held 1.428s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:41:52 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Created reservations ['1aa7090b-429e-44e2-909e-ffe94ec8308a', 'd3341ce7-5c57-4996-951f-2e1d6719d06a', 'abb7d12d-e5f1-4f65-a8fa-e6631668915f', '5cd71ce3-342b-4432-9005-35e82d292a67'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:41:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:41:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:41:53 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:41:53 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:41:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:41:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:41:53 devstack sudo[112763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:41:53 devstack sudo[112763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:41:53 devstack sudo[112763]: pam_unix(sudo:session): session closed for user root Jun 28 14:41:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.644s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:41:53 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:41:53 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Deleted volume successfully. Jun 28 14:41:53 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-552611bc-6b47-40ba-a28a-63e6c5830888 tempest-TestServerVolumeAttachmentScenario-1170075083 None] Lock "cinder-73c1746d-16e2-45d7-bdab-c008d27645fe-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:42:03 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:42:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-db0bc319-2a5f-4a40-97ad-61984fa0235e req-feac6af8-89f0-40ee-93c7-f42711d5293f tempest-TestStampPattern-2036258036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:42:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-db0bc319-2a5f-4a40-97ad-61984fa0235e req-feac6af8-89f0-40ee-93c7-f42711d5293f tempest-TestStampPattern-2036258036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:42:03 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[048615b1-6e40-443f-b788-dcbd326c5bad]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:42:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-db0bc319-2a5f-4a40-97ad-61984fa0235e req-feac6af8-89f0-40ee-93c7-f42711d5293f tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:42:03 devstack sudo[112786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 Jun 28 14:42:03 devstack sudo[112786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:42:03 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=11,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:42:04 devstack sudo[112786]: pam_unix(sudo:session): session closed for user root Jun 28 14:42:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-db0bc319-2a5f-4a40-97ad-61984fa0235e req-feac6af8-89f0-40ee-93c7-f42711d5293f tempest-TestStampPattern-2036258036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6" returned: 0 in 0.757s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:42:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-db0bc319-2a5f-4a40-97ad-61984fa0235e req-feac6af8-89f0-40ee-93c7-f42711d5293f tempest-TestStampPattern-2036258036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.774s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:42:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-db0bc319-2a5f-4a40-97ad-61984fa0235e req-feac6af8-89f0-40ee-93c7-f42711d5293f tempest-TestStampPattern-2036258036 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4fa3821b-c23e-42a1-b802-8498997256fc', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:42:04 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-db0bc319-2a5f-4a40-97ad-61984fa0235e req-feac6af8-89f0-40ee-93c7-f42711d5293f tempest-TestStampPattern-2036258036 None] attachment_update completed successfully. Jun 28 14:42:12 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-e03d73e9-7603-49bc-b596-54b4e882803d req-8c937637-da73-4311-a812-eeace3475744 tempest-TestStampPattern-2036258036 None] Terminate volume connection completed successfully. Jun 28 14:42:12 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-e03d73e9-7603-49bc-b596-54b4e882803d req-8c937637-da73-4311-a812-eeace3475744 tempest-TestStampPattern-2036258036 None] Deleting attachment 4fa3821b-c23e-42a1-b802-8498997256fc. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:42:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:42:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:42:14 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] Creating offline snapshot 356ed53a-2d0d-4608-a371-a340da117c37 of volume cc56c0c1-8e33-49a4-810e-51799bdfcaf6 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:42:14 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cba443-4942-4dcc-ae0a-29b58c9c3f5a]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:42:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:42:15 devstack sudo[113229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 Jun 28 14:42:15 devstack sudo[113229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:42:15 devstack sudo[113229]: pam_unix(sudo:session): session closed for user root Jun 28 14:42:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6" returned: 0 in 0.769s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:42:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:42:15 devstack sudo[113235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 1G Jun 28 14:42:15 devstack sudo[113235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:42:16 devstack sudo[113235]: pam_unix(sudo:session): session closed for user root Jun 28 14:42:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 1G" returned: 0 in 0.788s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:42:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:42:16 devstack sudo[113241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 Jun 28 14:42:16 devstack sudo[113241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:42:17 devstack sudo[113241]: pam_unix(sudo:session): session closed for user root Jun 28 14:42:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37" returned: 0 in 0.714s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:42:17 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 is being set with open permissions: ugo+rw Jun 28 14:42:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:42:17 devstack sudo[113253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 Jun 28 14:42:17 devstack sudo[113253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:42:17 devstack sudo[113253]: pam_unix(sudo:session): session closed for user root Jun 28 14:42:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37" returned: 0 in 0.625s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:42:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:42:17 devstack sudo[113256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.info Jun 28 14:42:17 devstack sudo[113256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:42:18 devstack sudo[113256]: pam_unix(sudo:session): session closed for user root Jun 28 14:42:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.info" returned: 0 in 0.645s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:42:18 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.info is being set with open permissions: ugo+rw Jun 28 14:42:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:42:18 devstack sudo[113259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.info Jun 28 14:42:18 devstack sudo[113259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:42:19 devstack sudo[113259]: pam_unix(sudo:session): session closed for user root Jun 28 14:42:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.info" returned: 0 in 0.636s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:42:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.258s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:42:19 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-482fcbf8-a6ed-4327-8e4a-3b31fce1c365 tempest-TestStampPattern-2036258036 None] Create snapshot completed successfully Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=13,cinder:UPDATE=3 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Flow 'volume_create_manager' (dc054fa2-75e9-4c62-ac0e-586c50f1a135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bae660-a989-4b31-bf50-67528ebe0306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bae660-a989-4b31-bf50-67528ebe0306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-48519849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf09fdc5-4287-4300-9b8c-c84da481f41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcfc5573e1e4bb4bdea1c37537b14d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=356ed53a-2d0d-4608-a371-a340da117c37,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:42:30Z,use_quota=True,user_id='14d7073d7a08441aa26ce264544ab58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d5c4ef-9512-430a-955f-d27c1c84bdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d5c4ef-9512-430a-955f-d27c1c84bdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc76a81-10be-4ea1-9c19-a7940f635789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc76a81-10be-4ea1-9c19-a7940f635789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf09fdc5-4287-4300-9b8c-c84da481f41b', 'volume_name': 'volume-cf09fdc5-4287-4300-9b8c-c84da481f41b', 'volume_size': 1, 'snapshot_id': '356ed53a-2d0d-4608-a371-a340da117c37'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39eb3a32-ccec-418b-92b5-79819773c108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39eb3a32-ccec-418b-92b5-79819773c108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98b1015-a722-4960-b209-d341cdfac457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:42:29 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Volume cf09fdc5-4287-4300-9b8c-c84da481f41b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf09fdc5-4287-4300-9b8c-c84da481f41b', 'volume_size': 1, 'snapshot_id': '356ed53a-2d0d-4608-a371-a340da117c37'} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Acquiring lock "cinder-quobyte-356ed53a-2d0d-4608-a371-a340da117c37-cf09fdc5-4287-4300-9b8c-c84da481f41b" by "_create_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Lock "cinder-quobyte-356ed53a-2d0d-4608-a371-a340da117c37-cf09fdc5-4287-4300-9b8c-c84da481f41b" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Creating volume cf09fdc5-4287-4300-9b8c-c84da481f41b from snapshot 356ed53a-2d0d-4608-a371-a340da117c37 {{(pid=93561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Acquiring lock "cinder-quobyte-cf09fdc5-4287-4300-9b8c-c84da481f41b" by "_copy_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Lock "cinder-quobyte-cf09fdc5-4287-4300-9b8c-c84da481f41b" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] snapshot: 356ed53a-2d0d-4608-a371-a340da117c37, volume: cf09fdc5-4287-4300-9b8c-c84da481f41b, {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6419065d-b8cc-4240-89e1-cf3485b379a4]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:42:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:42:30 devstack sudo[113308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 Jun 28 14:42:30 devstack sudo[113308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:42:30 devstack sudo[113308]: pam_unix(sudo:session): session closed for user root Jun 28 14:42:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37" returned: 0 in 0.790s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:42:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:42:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 28 14:42:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Creating direct copy from snapshot {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 28 14:42:30 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cea8a67-5898-4ade-807d-b559bd36bf34]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:42:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:42:30 devstack sudo[113317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 Jun 28 14:42:30 devstack sudo[113317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:42:31 devstack sudo[113317]: pam_unix(sudo:session): session closed for user root Jun 28 14:42:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6" returned: 0 in 0.757s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:42:31 devstack cinder-volume[93561]: DEBUG cinder.utils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Path /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b not found in is_blk_device check {{(pid=93561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 28 14:42:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:42:31 devstack sudo[113322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b Jun 28 14:42:31 devstack sudo[113322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:42:36 devstack sudo[113322]: pam_unix(sudo:session): session closed for user root Jun 28 14:42:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b" returned: 0 in 5.036s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:42:36 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbabb71-3cbb-46d7-8439-c5b1584f58ad]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:42:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:42:36 devstack sudo[113335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 Jun 28 14:42:36 devstack sudo[113335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:42:37 devstack sudo[113335]: pam_unix(sudo:session): session closed for user root Jun 28 14:42:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6" returned: 0 in 1.171s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:42:37 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Image conversion details: src /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:42:37 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Converted 1024.00 MB image at 203.31 MB/s Jun 28 14:42:37 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b is being set with open permissions: ugo+rw Jun 28 14:42:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:42:37 devstack sudo[113340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b Jun 28 14:42:37 devstack sudo[113340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:42:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:42:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:42:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:42:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:42:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:42:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:42:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:42:37 devstack sudo[113343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:42:37 devstack sudo[113343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:42:38 devstack sudo[113340]: pam_unix(sudo:session): session closed for user root Jun 28 14:42:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b" returned: 0 in 0.765s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:42:38 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Lock "cinder-quobyte-cf09fdc5-4287-4300-9b8c-c84da481f41b" released by "_copy_volume_from_snapshot" :: held 8.610s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:42:38 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Lock "cinder-quobyte-356ed53a-2d0d-4608-a371-a340da117c37-cf09fdc5-4287-4300-9b8c-c84da481f41b" released by "_create_volume_from_snapshot" :: held 8.647s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:42:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.666s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:42:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98b1015-a722-4960-b209-d341cdfac457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf09fdc5-4287-4300-9b8c-c84da481f41b', 'volume_size': 1, 'snapshot_id': '356ed53a-2d0d-4608-a371-a340da117c37'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:42:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676348c1-f2e6-4bbe-9deb-1f5158d45b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:42:38 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Volume volume-cf09fdc5-4287-4300-9b8c-c84da481f41b (cf09fdc5-4287-4300-9b8c-c84da481f41b): created successfully Jun 28 14:42:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676348c1-f2e6-4bbe-9deb-1f5158d45b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:42:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Flow 'volume_create_manager' (dc054fa2-75e9-4c62-ac0e-586c50f1a135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:42:38 devstack sudo[113343]: pam_unix(sudo:session): session closed for user root Jun 28 14:42:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.839s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:42:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:42:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:42:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 28 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:42:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:42:38 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-3774c4a0-b0e8-4758-a8d2-371ad686cb53 tempest-TestStampPattern-2036258036 None] Created volume successfully. Jun 28 14:42:48 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:42:48 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:43:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-ff8010fe-2dbc-435d-832e-7bfe5aabc04f req-05550c84-f438-448d-95d6-4ac6f7c99c3d tempest-TestStampPattern-2036258036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:43:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-ff8010fe-2dbc-435d-832e-7bfe5aabc04f req-05550c84-f438-448d-95d6-4ac6f7c99c3d tempest-TestStampPattern-2036258036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:43:13 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a20e82-0b41-4009-b4b7-d049741db715]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:43:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-ff8010fe-2dbc-435d-832e-7bfe5aabc04f req-05550c84-f438-448d-95d6-4ac6f7c99c3d tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:13 devstack sudo[113499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b Jun 28 14:43:13 devstack sudo[113499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:14 devstack sudo[113499]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [req-ff8010fe-2dbc-435d-832e-7bfe5aabc04f req-05550c84-f438-448d-95d6-4ac6f7c99c3d tempest-TestStampPattern-2036258036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b" returned: 0 in 0.786s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [req-ff8010fe-2dbc-435d-832e-7bfe5aabc04f req-05550c84-f438-448d-95d6-4ac6f7c99c3d tempest-TestStampPattern-2036258036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.803s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:43:14 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-ff8010fe-2dbc-435d-832e-7bfe5aabc04f req-05550c84-f438-448d-95d6-4ac6f7c99c3d tempest-TestStampPattern-2036258036 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb', 'name': 'volume-cf09fdc5-4287-4300-9b8c-c84da481f41b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f590a80-dbd3-44fb-91b7-03fdefad2459', 'enforce_multipath': True} {{(pid=93561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 28 14:43:14 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-ff8010fe-2dbc-435d-832e-7bfe5aabc04f req-05550c84-f438-448d-95d6-4ac6f7c99c3d tempest-TestStampPattern-2036258036 None] attachment_update completed successfully. Jun 28 14:43:21 devstack cinder-volume[93561]: INFO cinder.volume.manager [req-cdaf0b39-88d5-4bb0-b172-bd2da23cfc3b req-33376882-e2a9-4bdb-aa89-f08618300545 tempest-TestStampPattern-2036258036 None] Terminate volume connection completed successfully. Jun 28 14:43:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [req-cdaf0b39-88d5-4bb0-b172-bd2da23cfc3b req-33376882-e2a9-4bdb-aa89-f08618300545 tempest-TestStampPattern-2036258036 None] Deleting attachment 0f590a80-dbd3-44fb-91b7-03fdefad2459. {{(pid=93561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 28 14:43:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Acquiring lock "cinder-cf09fdc5-4287-4300-9b8c-c84da481f41b-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:43:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Lock "cinder-cf09fdc5-4287-4300-9b8c-c84da481f41b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:43:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Acquiring lock "cinder-quobyte-cf09fdc5-4287-4300-9b8c-c84da481f41b" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:43:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Lock "cinder-quobyte-cf09fdc5-4287-4300-9b8c-c84da481f41b" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:43:30 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9cc7c1-33ca-490a-b9b8-2ead4fe8414d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:43:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:30 devstack sudo[114002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b Jun 28 14:43:30 devstack sudo[114002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:30 devstack sudo[114002]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b" returned: 0 in 0.767s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:30 devstack sudo[114008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b Jun 28 14:43:30 devstack sudo[114008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:31 devstack sudo[114008]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cf09fdc5-4287-4300-9b8c-c84da481f41b" returned: 0 in 0.655s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:31 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Lock "cinder-quobyte-cf09fdc5-4287-4300-9b8c-c84da481f41b" released by "delete_volume" :: held 1.458s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:43:31 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Created reservations ['be4f4438-a571-42b9-8f8d-a232f0cc1b9f', 'acdc2e10-c66a-4666-8793-96064d85e8d3', '83eb2240-b125-4e42-9170-c0f1fc3443db', '269ae23e-d5a4-4640-b04f-0df461499aa4'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:43:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:43:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:43:31 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:43:31 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:43:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:43:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:31 devstack sudo[114011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:43:31 devstack sudo[114011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:32 devstack sudo[114011]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.666s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:32 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:43:32 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Deleted volume successfully. Jun 28 14:43:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-fd32b97a-04c9-4c53-80fe-ea1411d41692 tempest-TestStampPattern-2036258036 None] Lock "cinder-cf09fdc5-4287-4300-9b8c-c84da481f41b-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:43:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Acquiring lock "cinder-356ed53a-2d0d-4608-a371-a340da117c37-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:43:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Lock "cinder-356ed53a-2d0d-4608-a371-a340da117c37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:43:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Acquiring lock "cinder-quobyte-cc56c0c1-8e33-49a4-810e-51799bdfcaf6" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:43:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Lock "cinder-quobyte-cc56c0c1-8e33-49a4-810e-51799bdfcaf6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:43:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Acquiring lock "cinder-quobyte-356ed53a-2d0d-4608-a371-a340da117c37" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:43:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Lock "cinder-quobyte-356ed53a-2d0d-4608-a371-a340da117c37" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:43:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Deleting offline snapshot 356ed53a-2d0d-4608-a371-a340da117c37 of volume cc56c0c1-8e33-49a4-810e-51799bdfcaf6 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:43:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] snapshot_file for this snap is: volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:43:32 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfe5911-44b5-48c5-b0b3-12d530954f26]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:43:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:32 devstack sudo[114014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 Jun 28 14:43:32 devstack sudo[114014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:33 devstack sudo[114014]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37" returned: 0 in 0.740s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:43:33 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b33c8fe-03c9-408b-8738-6c711dea1fc0]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:43:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:33 devstack sudo[114019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 Jun 28 14:43:33 devstack sudo[114019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:34 devstack sudo[114019]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6" returned: 0 in 0.755s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:34 devstack sudo[114024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 Jun 28 14:43:34 devstack sudo[114024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:34 devstack sudo[114024]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37" returned: 0 in 0.725s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:34 devstack sudo[114030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37 Jun 28 14:43:34 devstack sudo[114030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:35 devstack sudo[114030]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6.356ed53a-2d0d-4608-a371-a340da117c37" returned: 0 in 0.659s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Lock "cinder-quobyte-356ed53a-2d0d-4608-a371-a340da117c37" released by "_delete_snapshot" :: held 2.971s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:43:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Lock "cinder-quobyte-cc56c0c1-8e33-49a4-810e-51799bdfcaf6" released by "delete_snapshot" :: held 2.991s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:43:35 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Created reservations ['761005b1-a710-4126-bb32-1ef9a38c8033', 'ef311909-f296-4c37-a3bc-74a22ce07dc6', '468d0f66-0021-4844-91d0-718b0cec95d9', 'bb2c79c9-b956-4cdf-a8ef-19324f5fd6b0'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:43:35 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Delete snapshot completed successfully. Jun 28 14:43:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-4cf6d89c-96a2-42cc-b6d1-3c01a2aa5962 tempest-TestStampPattern-2036258036 None] Lock "cinder-356ed53a-2d0d-4608-a371-a340da117c37-delete_snapshot" released by "delete_snapshot" :: held 3.126s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:43:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:43:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:43:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:43:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:43:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:43:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:43:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:37 devstack sudo[114064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:43:37 devstack sudo[114064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:38 devstack sudo[114064]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.736s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:43:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:43:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 28 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:43:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:43:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Acquiring lock "cinder-cc56c0c1-8e33-49a4-810e-51799bdfcaf6-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:43:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Lock "cinder-cc56c0c1-8e33-49a4-810e-51799bdfcaf6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:43:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Acquiring lock "cinder-quobyte-cc56c0c1-8e33-49a4-810e-51799bdfcaf6" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:43:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Lock "cinder-quobyte-cc56c0c1-8e33-49a4-810e-51799bdfcaf6" acquired by "delete_volume" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:43:42 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[02be2000-5e9b-4407-92b2-1c6b9c6fd323]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:43:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:43 devstack sudo[114085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 Jun 28 14:43:43 devstack sudo[114085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:43 devstack sudo[114085]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6" returned: 0 in 0.754s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:43 devstack sudo[114090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6 Jun 28 14:43:43 devstack sudo[114090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:44 devstack sudo[114090]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cc56c0c1-8e33-49a4-810e-51799bdfcaf6" returned: 0 in 0.632s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:44 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Lock "cinder-quobyte-cc56c0c1-8e33-49a4-810e-51799bdfcaf6" released by "delete_volume" :: held 1.443s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:43:44 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Created reservations ['9feb6e64-4342-4206-b6bb-cce319638150', 'c480ca6f-226b-4aab-ac83-74ef3028fe63', '80528ab5-a9f9-4006-b4a7-c86f9b12db85', 'df2af972-d04b-4ba3-9762-587dfbc6988f'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:43:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:43:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:43:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:43:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:43:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:43:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:44 devstack sudo[114093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:43:44 devstack sudo[114093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:45 devstack sudo[114093]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.669s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:45 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:43:45 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Deleted volume successfully. Jun 28 14:43:45 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ba2b0ffb-4004-449f-a325-96d1a49eeb4e tempest-TestStampPattern-2036258036 None] Lock "cinder-cc56c0c1-8e33-49a4-810e-51799bdfcaf6-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:43:54 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=19,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:43:54 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:43:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Flow 'volume_create_manager' (498caf09-a911-4214-a00e-f29bb5c0e9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:43:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca69a325-91d1-43ae-9f18-ddbbf87c9762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:43:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca69a325-91d1-43ae-9f18-ddbbf87c9762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f12317-b1e0-489a-828d-b18b9d500997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb9d1a336ca4415b1f91d97979f9cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:43:55Z,use_quota=True,user_id='ab832802f9334c5e85174e659d49e73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:43:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdfc4fc-70f0-4f7f-bc95-72d98e235e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:43:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdfc4fc-70f0-4f7f-bc95-72d98e235e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:43:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54cd56ef-0332-4f0a-9144-039fa16af918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:43:54 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54cd56ef-0332-4f0a-9144-039fa16af918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5f12317-b1e0-489a-828d-b18b9d500997', 'volume_name': 'volume-f5f12317-b1e0-489a-828d-b18b9d500997', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c1cb2b-c946-4070-ad74-7e2a1f17d1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c1cb2b-c946-4070-ad74-7e2a1f17d1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (120645a2-f9a4-44e4-9350-92c018cbde2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:43:55 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Volume f5f12317-b1e0-489a-828d-b18b9d500997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5f12317-b1e0-489a-828d-b18b9d500997', 'volume_size': 1} Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f12317-b1e0-489a-828d-b18b9d500997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb9d1a336ca4415b1f91d97979f9cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:43:55Z,use_quota=True,user_id='ab832802f9334c5e85174e659d49e73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Creating volume f5f12317-b1e0-489a-828d-b18b9d500997 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:43:55 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f5f12317-b1e0-489a-828d-b18b9d500997 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:55 devstack sudo[114137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f5f12317-b1e0-489a-828d-b18b9d500997 1073741824 Jun 28 14:43:55 devstack sudo[114137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:55 devstack sudo[114137]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f5f12317-b1e0-489a-828d-b18b9d500997 1073741824" returned: 0 in 0.797s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f5f12317-b1e0-489a-828d-b18b9d500997 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:55 devstack sudo[114143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f5f12317-b1e0-489a-828d-b18b9d500997 Jun 28 14:43:55 devstack sudo[114143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:56 devstack sudo[114143]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f5f12317-b1e0-489a-828d-b18b9d500997" returned: 0 in 0.633s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:43:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:43:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (120645a2-f9a4-44e4-9350-92c018cbde2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f12317-b1e0-489a-828d-b18b9d500997', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:43:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a172f2-0993-43e6-be6d-0dddd6826a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:43:56 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Volume volume-f5f12317-b1e0-489a-828d-b18b9d500997 (f5f12317-b1e0-489a-828d-b18b9d500997): created successfully Jun 28 14:43:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a172f2-0993-43e6-be6d-0dddd6826a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:43:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Flow 'volume_create_manager' (498caf09-a911-4214-a00e-f29bb5c0e9db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:43:56 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e64b7309-05b5-4b47-8037-8487a79ef7f2 tempest-CinderUnicodeTest-1130405972 None] Created volume successfully. Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Flow 'volume_create_manager' (b9e2c38e-4421-4307-969e-dda355744df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597bc1eb-1deb-46e3-af32-0a78dfc4c32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597bc1eb-1deb-46e3-af32-0a78dfc4c32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:43:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-834532029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4511bd11-945e-4ec4-8b4f-27a9443ed503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb9d1a336ca4415b1f91d97979f9cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:43:57Z,use_quota=True,user_id='ab832802f9334c5e85174e659d49e73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f079ea1-69c3-40e3-ae39-6a02f29e7c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f079ea1-69c3-40e3-ae39-6a02f29e7c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fbd7c1-d31e-4d3e-a2a3-17e731574dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fbd7c1-d31e-4d3e-a2a3-17e731574dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4511bd11-945e-4ec4-8b4f-27a9443ed503', 'volume_name': 'volume-4511bd11-945e-4ec4-8b4f-27a9443ed503', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f48dc7-71c8-4c42-8ff9-15b32854c0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f48dc7-71c8-4c42-8ff9-15b32854c0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6c9caf-cb56-45bc-9dc6-bb968df92697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:43:57 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Volume 4511bd11-945e-4ec4-8b4f-27a9443ed503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4511bd11-945e-4ec4-8b4f-27a9443ed503', 'volume_size': 1} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:43:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-834532029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4511bd11-945e-4ec4-8b4f-27a9443ed503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb9d1a336ca4415b1f91d97979f9cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:43:57Z,use_quota=True,user_id='ab832802f9334c5e85174e659d49e73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Creating volume 4511bd11-945e-4ec4-8b4f-27a9443ed503 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:43:57 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:43:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:57 devstack sudo[114146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 1073741824 Jun 28 14:43:57 devstack sudo[114146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:58 devstack sudo[114146]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 1073741824" returned: 0 in 0.789s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:58 devstack sudo[114152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 Jun 28 14:43:58 devstack sudo[114152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:43:59 devstack sudo[114152]: pam_unix(sudo:session): session closed for user root Jun 28 14:43:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503" returned: 0 in 0.631s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:43:59 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:43:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:43:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6c9caf-cb56-45bc-9dc6-bb968df92697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4511bd11-945e-4ec4-8b4f-27a9443ed503', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:43:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc81a63-9500-4a9c-bc4f-bbeb365121b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:43:59 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Volume volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 (4511bd11-945e-4ec4-8b4f-27a9443ed503): created successfully Jun 28 14:43:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc81a63-9500-4a9c-bc4f-bbeb365121b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:43:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Flow 'volume_create_manager' (b9e2c38e-4421-4307-969e-dda355744df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:43:59 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-1b931b1c-b733-4600-95ed-07f416d04b8c tempest-CinderUnicodeTest-1130405972 None] Created volume successfully. Jun 28 14:43:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:43:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:43:59 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] Creating offline snapshot 4649a459-fd51-4fdb-b92f-e2e7056a0089 of volume 4511bd11-945e-4ec4-8b4f-27a9443ed503 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:43:59 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[292eeb6a-6383-4a8d-beaa-1ba229caa4e6]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:43:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:43:59 devstack sudo[114155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 Jun 28 14:43:59 devstack sudo[114155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:00 devstack sudo[114155]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503" returned: 0 in 0.741s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:00 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:00 devstack sudo[114161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089 1G Jun 28 14:44:00 devstack sudo[114161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:01 devstack sudo[114161]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089 1G" returned: 0 in 0.755s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:01 devstack sudo[114166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089 Jun 28 14:44:01 devstack sudo[114166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:01 devstack sudo[114166]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089" returned: 0 in 0.667s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:01 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089 is being set with open permissions: ugo+rw Jun 28 14:44:01 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:01 devstack sudo[114171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089 Jun 28 14:44:01 devstack sudo[114171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:02 devstack sudo[114171]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089" returned: 0 in 0.612s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:02 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:02 devstack sudo[114174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.info Jun 28 14:44:02 devstack sudo[114174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:03 devstack sudo[114174]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.info" returned: 0 in 0.629s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:03 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.info is being set with open permissions: ugo+rw Jun 28 14:44:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:03 devstack sudo[114177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.info Jun 28 14:44:03 devstack sudo[114177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:03 devstack sudo[114177]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.info" returned: 0 in 0.616s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.110s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:44:03 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ae282c46-9bec-4912-b726-85f16dc1f6e6 tempest-CinderUnicodeTest-1130405972 None] Create snapshot completed successfully Jun 28 14:44:04 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Acquiring lock "cinder-4649a459-fd51-4fdb-b92f-e2e7056a0089-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:04 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Lock "cinder-4649a459-fd51-4fdb-b92f-e2e7056a0089-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Acquiring lock "cinder-quobyte-4511bd11-945e-4ec4-8b4f-27a9443ed503" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Lock "cinder-quobyte-4511bd11-945e-4ec4-8b4f-27a9443ed503" acquired by "delete_snapshot" :: waited 0.013s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Acquiring lock "cinder-quobyte-4649a459-fd51-4fdb-b92f-e2e7056a0089" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Lock "cinder-quobyte-4649a459-fd51-4fdb-b92f-e2e7056a0089" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Deleting offline snapshot 4649a459-fd51-4fdb-b92f-e2e7056a0089 of volume 4511bd11-945e-4ec4-8b4f-27a9443ed503 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:44:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] snapshot_file for this snap is: volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:44:05 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7470adb9-9f2c-40b4-b1da-b1a5c64606d6]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:44:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:05 devstack sudo[114180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089 Jun 28 14:44:05 devstack sudo[114180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:05 devstack sudo[114180]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089" returned: 0 in 0.730s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4511bd11-945e-4ec4-8b4f-27a9443ed503(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:44:05 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[78338118-6deb-4bdf-a0c0-91899c075412]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:44:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:05 devstack sudo[114185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 Jun 28 14:44:05 devstack sudo[114185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:06 devstack sudo[114185]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503" returned: 0 in 0.721s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:06 devstack sudo[114190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089 Jun 28 14:44:06 devstack sudo[114190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:07 devstack sudo[114190]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089" returned: 0 in 0.701s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:07 devstack sudo[114195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089 Jun 28 14:44:07 devstack sudo[114195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:07 devstack sudo[114195]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503.4649a459-fd51-4fdb-b92f-e2e7056a0089" returned: 0 in 0.624s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:07 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Lock "cinder-quobyte-4649a459-fd51-4fdb-b92f-e2e7056a0089" released by "_delete_snapshot" :: held 2.879s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:44:07 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Lock "cinder-quobyte-4511bd11-945e-4ec4-8b4f-27a9443ed503" released by "delete_snapshot" :: held 2.898s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:44:07 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Created reservations ['356ea8d1-8156-4238-a3d7-c02073d7d2be', 'e7aa12fe-781a-45ac-9584-b1e29b9db40b', '2728fa90-91d1-4f57-b96b-d4288999b7a7', '12f25451-2ecb-4532-b064-d252f36b58ea'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:44:08 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Delete snapshot completed successfully. Jun 28 14:44:08 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2b9088bf-570a-474e-95c8-2bd0bddf9883 tempest-CinderUnicodeTest-1130405972 None] Lock "cinder-4649a459-fd51-4fdb-b92f-e2e7056a0089-delete_snapshot" released by "delete_snapshot" :: held 3.016s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:44:08 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Acquiring lock "cinder-4511bd11-945e-4ec4-8b4f-27a9443ed503-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:08 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Lock "cinder-4511bd11-945e-4ec4-8b4f-27a9443ed503-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:08 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Acquiring lock "cinder-quobyte-4511bd11-945e-4ec4-8b4f-27a9443ed503" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:08 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Lock "cinder-quobyte-4511bd11-945e-4ec4-8b4f-27a9443ed503" acquired by "delete_volume" :: waited 0.013s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:08 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f349ee-8cfe-4ec9-bd83-c47788936e9b]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:44:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:08 devstack sudo[114198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 Jun 28 14:44:08 devstack sudo[114198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:08 devstack sudo[114198]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503" returned: 0 in 0.722s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:09 devstack sudo[114203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503 Jun 28 14:44:09 devstack sudo[114203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:09 devstack sudo[114203]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4511bd11-945e-4ec4-8b4f-27a9443ed503" returned: 0 in 0.630s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Lock "cinder-quobyte-4511bd11-945e-4ec4-8b4f-27a9443ed503" released by "delete_volume" :: held 1.407s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:44:09 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=40,cinder:UPDATE=38,cinder:INSERT=7,cinder:DELETE=4 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:44:09 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Created reservations ['adfed66b-8204-47b0-839d-68c9d036223a', '0efe9bd2-3385-4a70-bfec-5823f6672d81', 'c6dabd40-d3c6-40c7-b2b1-9bf706344913', 'ffaa2277-966e-4ceb-9363-2a4af060afe9'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:44:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:44:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:44:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:44:09 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:44:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:44:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:09 devstack sudo[114206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:44:09 devstack sudo[114206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:10 devstack sudo[114206]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.634s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:10 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:44:10 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Deleted volume successfully. Jun 28 14:44:10 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Acquiring lock "cinder-f5f12317-b1e0-489a-828d-b18b9d500997-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:10 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-504b433c-83f2-4e95-9ca8-533139fad73f tempest-CinderUnicodeTest-1130405972 None] Lock "cinder-4511bd11-945e-4ec4-8b4f-27a9443ed503-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:44:10 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Lock "cinder-f5f12317-b1e0-489a-828d-b18b9d500997-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:10 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Acquiring lock "cinder-quobyte-f5f12317-b1e0-489a-828d-b18b9d500997" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:10 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Lock "cinder-quobyte-f5f12317-b1e0-489a-828d-b18b9d500997" acquired by "delete_volume" :: waited 0.013s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:10 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[442d7597-5dac-4dba-97ea-295140417709]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:44:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f5f12317-b1e0-489a-828d-b18b9d500997 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:10 devstack sudo[114210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f5f12317-b1e0-489a-828d-b18b9d500997 Jun 28 14:44:10 devstack sudo[114210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:11 devstack sudo[114210]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f5f12317-b1e0-489a-828d-b18b9d500997" returned: 0 in 0.749s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f5f12317-b1e0-489a-828d-b18b9d500997 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:11 devstack sudo[114215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f5f12317-b1e0-489a-828d-b18b9d500997 Jun 28 14:44:11 devstack sudo[114215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:11 devstack sudo[114215]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-f5f12317-b1e0-489a-828d-b18b9d500997" returned: 0 in 0.640s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Lock "cinder-quobyte-f5f12317-b1e0-489a-828d-b18b9d500997" released by "delete_volume" :: held 1.425s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:44:11 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Created reservations ['3c22bed4-2b9d-4abb-a9a5-ca47238efde9', '914139b2-c354-454d-9cd4-e1afc255ac45', 'ac091fa6-c765-40d6-8c90-621cee506a78', '1df2fbf9-bb7e-4dd8-87e0-450d71bcf06b'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:44:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:44:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:44:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:44:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:44:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:44:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:12 devstack sudo[114218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:44:12 devstack sudo[114218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:12 devstack sudo[114218]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.620s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:12 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:44:12 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Deleted volume successfully. Jun 28 14:44:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8da5e512-ea6f-4aa2-b283-9cfad9724b0c tempest-CinderUnicodeTest-1130405972 None] Lock "cinder-f5f12317-b1e0-489a-828d-b18b9d500997-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:44:21 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=26,cinder:UPDATE=28,cinder:INSERT=12 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:44:22 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:UPDATE=16,cinder:SELECT=6,cinder:DELETE=2,cinder:INSERT=2 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Flow 'volume_create_manager' (a965d90a-132e-46ab-8688-feff9b2974a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb135cd5-c10b-4239-b572-5509c27bcacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb135cd5-c10b-4239-b572-5509c27bcacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1928609572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4f2b26-d89e-4b5a-8c00-d4c1069cd738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffbdf43adc74ae68fa096a3551ec235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:44:34Z,use_quota=True,user_id='62a491ce73c742acac0892ec3fc32018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb2afbd-11ae-45f1-8bca-6ab0cd3e21a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb2afbd-11ae-45f1-8bca-6ab0cd3e21a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badd2a8c-717d-4d05-aa67-507879825720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badd2a8c-717d-4d05-aa67-507879825720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4f2b26-d89e-4b5a-8c00-d4c1069cd738', 'volume_name': 'volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73266cb-563b-4d3d-9e62-e79bc19b0035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73266cb-563b-4d3d-9e62-e79bc19b0035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1a15fe-ba3c-417f-8b3d-e81180b1bb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:44:34 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Volume 2b4f2b26-d89e-4b5a-8c00-d4c1069cd738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738', 'volume_size': 1} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1928609572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4f2b26-d89e-4b5a-8c00-d4c1069cd738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffbdf43adc74ae68fa096a3551ec235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:44:34Z,use_quota=True,user_id='62a491ce73c742acac0892ec3fc32018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Creating volume 2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:44:34 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:44:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:34 devstack sudo[114235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 1073741824 Jun 28 14:44:34 devstack sudo[114235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:35 devstack sudo[114235]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 1073741824" returned: 0 in 0.784s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:35 devstack sudo[114240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 Jun 28 14:44:35 devstack sudo[114240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:35 devstack sudo[114240]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738" returned: 0 in 0.621s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:44:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:44:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1a15fe-ba3c-417f-8b3d-e81180b1bb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:44:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753b58f7-0035-4db1-9845-27d000de5db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:44:35 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Volume volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 (2b4f2b26-d89e-4b5a-8c00-d4c1069cd738): created successfully Jun 28 14:44:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753b58f7-0035-4db1-9845-27d000de5db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:44:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Flow 'volume_create_manager' (a965d90a-132e-46ab-8688-feff9b2974a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:44:36 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f8bf4e90-0473-4d62-a7e6-2e69c3c00378 tempest-SnapshotDependencyTests-40948596 None] Created volume successfully. Jun 28 14:44:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:44:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:44:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] Creating offline snapshot f3ed4a13-6915-4683-8c8b-0ccc47d48140 of volume 2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:44:36 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6844db-0b0e-49c6-9b92-cbf816bb2f89]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:44:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:36 devstack sudo[114243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 Jun 28 14:44:36 devstack sudo[114243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:37 devstack sudo[114243]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738" returned: 0 in 0.751s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:37 devstack sudo[114248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 1G Jun 28 14:44:37 devstack sudo[114248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:44:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:44:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:44:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:44:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:44:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:44:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:37 devstack sudo[114250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:44:37 devstack sudo[114250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 1G" returned: 0 in 0.851s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:38 devstack sudo[114248]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:38 devstack sudo[114256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 Jun 28 14:44:38 devstack sudo[114256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:38 devstack sudo[114250]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.699s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:44:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:44:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 28 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:44:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:44:39 devstack sudo[114256]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140" returned: 0 in 0.703s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:39 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 is being set with open permissions: ugo+rw Jun 28 14:44:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:39 devstack sudo[114262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 Jun 28 14:44:39 devstack sudo[114262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:39 devstack sudo[114262]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140" returned: 0 in 0.619s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:39 devstack sudo[114265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.info Jun 28 14:44:39 devstack sudo[114265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:40 devstack sudo[114265]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.info" returned: 0 in 0.633s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:40 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.info is being set with open permissions: ugo+rw Jun 28 14:44:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:40 devstack sudo[114268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.info Jun 28 14:44:40 devstack sudo[114268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:40 devstack sudo[114268]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.info" returned: 0 in 0.631s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.270s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:44:40 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-1ce4d2d5-30e5-4cc1-af34-cc2695ae475d tempest-SnapshotDependencyTests-40948596 None] Create snapshot completed successfully Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Flow 'volume_create_manager' (a4367222-afdb-46d9-9f77-0cd732d8edca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c594c0-6b96-49eb-a56c-f5f135e4faa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c594c0-6b96-49eb-a56c-f5f135e4faa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d823469f-08e9-4e32-8158-6e7f392a1166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffbdf43adc74ae68fa096a3551ec235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f3ed4a13-6915-4683-8c8b-0ccc47d48140,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:44:42Z,use_quota=True,user_id='62a491ce73c742acac0892ec3fc32018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ace08a-f6d9-4dd5-86c7-c537e3bda9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ace08a-f6d9-4dd5-86c7-c537e3bda9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5edae6-ebf6-4974-84c1-79d1680bf257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5edae6-ebf6-4974-84c1-79d1680bf257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd823469f-08e9-4e32-8158-6e7f392a1166', 'volume_name': 'volume-d823469f-08e9-4e32-8158-6e7f392a1166', 'volume_size': 1, 'snapshot_id': 'f3ed4a13-6915-4683-8c8b-0ccc47d48140'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5e1482-e6d0-4ae5-a225-141d858575c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5e1482-e6d0-4ae5-a225-141d858575c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (289a6c5e-db99-46dc-862c-ae924e877724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:44:42 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Volume d823469f-08e9-4e32-8158-6e7f392a1166: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d823469f-08e9-4e32-8158-6e7f392a1166', 'volume_size': 1, 'snapshot_id': 'f3ed4a13-6915-4683-8c8b-0ccc47d48140'} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "cinder-quobyte-f3ed4a13-6915-4683-8c8b-0ccc47d48140-d823469f-08e9-4e32-8158-6e7f392a1166" by "_create_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-quobyte-f3ed4a13-6915-4683-8c8b-0ccc47d48140-d823469f-08e9-4e32-8158-6e7f392a1166" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Creating volume d823469f-08e9-4e32-8158-6e7f392a1166 from snapshot f3ed4a13-6915-4683-8c8b-0ccc47d48140 {{(pid=93561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "cinder-quobyte-d823469f-08e9-4e32-8158-6e7f392a1166" by "_copy_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-quobyte-d823469f-08e9-4e32-8158-6e7f392a1166" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] snapshot: f3ed4a13-6915-4683-8c8b-0ccc47d48140, volume: d823469f-08e9-4e32-8158-6e7f392a1166, {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa00995-9772-4423-9ab8-ef63687e3a0a]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:44:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:42 devstack sudo[114273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 Jun 28 14:44:42 devstack sudo[114273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:43 devstack sudo[114273]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140" returned: 0 in 0.741s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:44:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 28 14:44:43 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Creating direct copy from snapshot {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 28 14:44:43 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abb039f-645c-414b-bcc8-ea588827a882]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:44:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:43 devstack sudo[114278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 Jun 28 14:44:43 devstack sudo[114278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:44 devstack sudo[114278]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738" returned: 0 in 0.740s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:44 devstack cinder-volume[93561]: DEBUG cinder.utils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Path /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d823469f-08e9-4e32-8158-6e7f392a1166 not found in is_blk_device check {{(pid=93561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 28 14:44:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d823469f-08e9-4e32-8158-6e7f392a1166 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:44 devstack sudo[114283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d823469f-08e9-4e32-8158-6e7f392a1166 Jun 28 14:44:44 devstack sudo[114283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:48 devstack sudo[114283]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d823469f-08e9-4e32-8158-6e7f392a1166" returned: 0 in 4.562s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:48 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a880dc-64b4-4a21-a80b-20a93e5c7e9f]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:44:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:48 devstack sudo[114332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 Jun 28 14:44:48 devstack sudo[114332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:49 devstack sudo[114332]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738" returned: 0 in 0.931s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:49 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Image conversion details: src /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738, size 1024.00 MB, duration 4.56 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d823469f-08e9-4e32-8158-6e7f392a1166 {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:44:49 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Converted 1024.00 MB image at 224.41 MB/s Jun 28 14:44:49 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d823469f-08e9-4e32-8158-6e7f392a1166 is being set with open permissions: ugo+rw Jun 28 14:44:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d823469f-08e9-4e32-8158-6e7f392a1166 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:49 devstack sudo[114337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d823469f-08e9-4e32-8158-6e7f392a1166 Jun 28 14:44:49 devstack sudo[114337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:50 devstack sudo[114337]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d823469f-08e9-4e32-8158-6e7f392a1166" returned: 0 in 0.631s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-quobyte-d823469f-08e9-4e32-8158-6e7f392a1166" released by "_copy_volume_from_snapshot" :: held 7.690s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:44:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-quobyte-f3ed4a13-6915-4683-8c8b-0ccc47d48140-d823469f-08e9-4e32-8158-6e7f392a1166" released by "_create_volume_from_snapshot" :: held 7.716s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:44:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.730s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:44:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (289a6c5e-db99-46dc-862c-ae924e877724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d823469f-08e9-4e32-8158-6e7f392a1166', 'volume_size': 1, 'snapshot_id': 'f3ed4a13-6915-4683-8c8b-0ccc47d48140'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:44:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed73a3ed-2f49-463b-bf77-4bfe8945216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:44:50 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Volume volume-d823469f-08e9-4e32-8158-6e7f392a1166 (d823469f-08e9-4e32-8158-6e7f392a1166): created successfully Jun 28 14:44:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed73a3ed-2f49-463b-bf77-4bfe8945216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:44:50 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Flow 'volume_create_manager' (a4367222-afdb-46d9-9f77-0cd732d8edca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:44:50 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-0c084492-4a14-448f-ba28-dc60d598dbd9 tempest-SnapshotDependencyTests-40948596 None] Created volume successfully. Jun 28 14:44:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "cinder-f3ed4a13-6915-4683-8c8b-0ccc47d48140-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-f3ed4a13-6915-4683-8c8b-0ccc47d48140-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "cinder-quobyte-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-quobyte-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "cinder-quobyte-f3ed4a13-6915-4683-8c8b-0ccc47d48140" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-quobyte-f3ed4a13-6915-4683-8c8b-0ccc47d48140" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Deleting offline snapshot f3ed4a13-6915-4683-8c8b-0ccc47d48140 of volume 2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:44:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] snapshot_file for this snap is: volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:44:51 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[49172c4b-c6ad-4865-995a-7647d1651bee]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:44:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:51 devstack sudo[114341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 Jun 28 14:44:51 devstack sudo[114341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:51 devstack sudo[114341]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140" returned: 0 in 0.733s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:44:51 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c812a3a5-b22d-4460-b6c5-bb07bff2a64e]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:44:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:52 devstack sudo[114346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 Jun 28 14:44:52 devstack sudo[114346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:52 devstack sudo[114346]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738" returned: 0 in 0.733s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:52 devstack sudo[114351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 Jun 28 14:44:52 devstack sudo[114351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:53 devstack sudo[114351]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140" returned: 0 in 0.700s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:53 devstack sudo[114356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140 Jun 28 14:44:53 devstack sudo[114356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:54 devstack sudo[114356]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738.f3ed4a13-6915-4683-8c8b-0ccc47d48140" returned: 0 in 0.613s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-quobyte-f3ed4a13-6915-4683-8c8b-0ccc47d48140" released by "_delete_snapshot" :: held 2.873s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:44:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-quobyte-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738" released by "delete_snapshot" :: held 2.894s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:44:54 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Created reservations ['c4584dbd-93e5-4917-9f5c-09e5f9ee9a27', 'bef06dab-697f-4e44-8da5-a27a5c23f32b', '6d418508-583a-4600-8ae6-acd833f179d2', '5984ab8a-e883-48f5-bbc6-c7d23233cb67'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:44:54 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Delete snapshot completed successfully. Jun 28 14:44:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-508e76d7-f730-4e67-b432-7a03e06155f7 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-f3ed4a13-6915-4683-8c8b-0ccc47d48140-delete_snapshot" released by "delete_snapshot" :: held 3.017s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:44:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "cinder-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "cinder-quobyte-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-quobyte-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:54 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[07313d18-e528-4c13-9c5c-b8480dcae040]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:44:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:54 devstack sudo[114359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 Jun 28 14:44:54 devstack sudo[114359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:55 devstack sudo[114359]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738" returned: 0 in 0.746s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:55 devstack sudo[114364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738 Jun 28 14:44:55 devstack sudo[114364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:55 devstack sudo[114364]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738" returned: 0 in 0.630s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-quobyte-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738" released by "delete_volume" :: held 1.430s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:44:55 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Created reservations ['8c708df2-ea4b-49ae-8af7-11961e14a74a', 'cf6ae7a7-ec50-43ac-8963-8d838e1a7e91', '7a36db77-e2a4-4d76-8ffb-87e8c624dd79', 'a5768cbc-ca79-4524-a3f7-2a398a21cac5'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:44:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:44:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:44:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:44:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:44:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:44:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:55 devstack sudo[114367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:44:55 devstack sudo[114367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "cinder-d823469f-08e9-4e32-8158-6e7f392a1166-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-d823469f-08e9-4e32-8158-6e7f392a1166-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:56 devstack sudo[114367]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.632s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:56 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:44:56 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Deleted volume successfully. Jun 28 14:44:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ee1835ec-be56-4246-a8a5-72cbc7129722 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-2b4f2b26-d89e-4b5a-8c00-d4c1069cd738-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:44:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "cinder-quobyte-d823469f-08e9-4e32-8158-6e7f392a1166" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:44:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-quobyte-d823469f-08e9-4e32-8158-6e7f392a1166" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:44:56 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a378f1-9c3b-4fbd-a47c-4e54ebabb4d6]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:44:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d823469f-08e9-4e32-8158-6e7f392a1166 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:56 devstack sudo[114370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d823469f-08e9-4e32-8158-6e7f392a1166 Jun 28 14:44:56 devstack sudo[114370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:57 devstack sudo[114370]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d823469f-08e9-4e32-8158-6e7f392a1166" returned: 0 in 0.732s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d823469f-08e9-4e32-8158-6e7f392a1166 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:57 devstack sudo[114375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d823469f-08e9-4e32-8158-6e7f392a1166 Jun 28 14:44:57 devstack sudo[114375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:58 devstack sudo[114375]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-d823469f-08e9-4e32-8158-6e7f392a1166" returned: 0 in 0.627s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:58 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-quobyte-d823469f-08e9-4e32-8158-6e7f392a1166" released by "delete_volume" :: held 1.400s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:44:58 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Created reservations ['7981fe59-16cd-4a4e-b314-a845f5cce788', '06810f4b-b296-428a-a319-e0be43464db1', '4bbeaee7-0414-44e7-9b02-6e01c29f29f0', '12e1714c-cd1d-47b9-80a0-3df5513a13c8'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:44:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:44:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:44:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:44:58 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:44:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:44:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:44:58 devstack sudo[114378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:44:58 devstack sudo[114378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:44:58 devstack sudo[114378]: pam_unix(sudo:session): session closed for user root Jun 28 14:44:58 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.644s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:44:58 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:44:58 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Deleted volume successfully. Jun 28 14:44:58 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f8984ee8-10f4-414a-9d5f-f1055cb1acc2 tempest-SnapshotDependencyTests-40948596 None] Lock "cinder-d823469f-08e9-4e32-8158-6e7f392a1166-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:08 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=19,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=6 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:45:08 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=28,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=2 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Flow 'volume_create_manager' (dff36949-f2ce-46df-8ab4-f5272bfb39b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94433a09-1858-4749-800e-7d7a6b6c046a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94433a09-1858-4749-800e-7d7a6b6c046a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-971514789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff704ae-a42f-41d4-98f7-c15aedbea671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016c476851e6485a87913aea6dde51e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:18Z,use_quota=True,user_id='f7402c7483cd445289523f518b68046a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67df36a-22a6-4512-97fc-53d21a5a821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67df36a-22a6-4512-97fc-53d21a5a821b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97d0588-a620-4273-8a57-29d30ce299cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97d0588-a620-4273-8a57-29d30ce299cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ff704ae-a42f-41d4-98f7-c15aedbea671', 'volume_name': 'volume-4ff704ae-a42f-41d4-98f7-c15aedbea671', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ed659e-31de-4c54-baab-4f9175d08513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ed659e-31de-4c54-baab-4f9175d08513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c860fcd8-c157-4d43-ab05-066eaee52652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:18 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Volume 4ff704ae-a42f-41d4-98f7-c15aedbea671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ff704ae-a42f-41d4-98f7-c15aedbea671', 'volume_size': 1} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-971514789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff704ae-a42f-41d4-98f7-c15aedbea671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016c476851e6485a87913aea6dde51e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:18Z,use_quota=True,user_id='f7402c7483cd445289523f518b68046a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Creating volume 4ff704ae-a42f-41d4-98f7-c15aedbea671 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:45:18 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4ff704ae-a42f-41d4-98f7-c15aedbea671 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:18 devstack sudo[114430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4ff704ae-a42f-41d4-98f7-c15aedbea671 1073741824 Jun 28 14:45:18 devstack sudo[114430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Flow 'volume_create_manager' (5f7c9a49-5833-452c-8c26-20b64c2bc5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef46bb34-4e33-4aac-9697-ace5d482fc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef46bb34-4e33-4aac-9697-ace5d482fc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2050629984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b28aaac-c11b-4deb-bd15-fddc847ab1af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e36088d2cdc4222a7538b56934037f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:18Z,use_quota=True,user_id='69e7c7853eeb4288961cdc350961464f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec798910-1c31-4605-b7c7-c79647f3b623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec798910-1c31-4605-b7c7-c79647f3b623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34128ee-e102-4d53-9adf-7859fcdb12c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34128ee-e102-4d53-9adf-7859fcdb12c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b28aaac-c11b-4deb-bd15-fddc847ab1af', 'volume_name': 'volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24e28b6-e9d6-4e84-92b6-edb56c9f8ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24e28b6-e9d6-4e84-92b6-edb56c9f8ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f586f11-f0f4-4536-9bcd-eddeb105c3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:18 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume 5b28aaac-c11b-4deb-bd15-fddc847ab1af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af', 'volume_size': 1} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Flow 'volume_create_manager' (c753039d-1b3a-4eb5-b241-c8601dc97187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa4af04-885f-4765-bff9-3b3d2df8f735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa4af04-885f-4765-bff9-3b3d2df8f735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1772118094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c85e20-6ae6-42ee-8804-65265b9d727a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016c476851e6485a87913aea6dde51e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:19Z,use_quota=True,user_id='f7402c7483cd445289523f518b68046a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f541b7-c74f-4374-b6da-6849a031dfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f541b7-c74f-4374-b6da-6849a031dfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b738e7ad-2a5f-44c2-b4db-8db8c1a573fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b738e7ad-2a5f-44c2-b4db-8db8c1a573fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c85e20-6ae6-42ee-8804-65265b9d727a', 'volume_name': 'volume-57c85e20-6ae6-42ee-8804-65265b9d727a', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e712a27e-a00e-4cb9-98f8-a5e8799945c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e712a27e-a00e-4cb9-98f8-a5e8799945c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d318644d-18f0-45ee-b8ca-7e0a189f8933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:18 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Volume 57c85e20-6ae6-42ee-8804-65265b9d727a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c85e20-6ae6-42ee-8804-65265b9d727a', 'volume_size': 1} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Flow 'volume_create_manager' (74d14508-9fae-46b7-914c-d6825d8d6f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f9a1a3-010e-4e95-9f9f-6be3d4572e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f9a1a3-010e-4e95-9f9f-6be3d4572e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-203998051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8af082-36eb-413f-ba5d-0ba1d6f4862c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016c476851e6485a87913aea6dde51e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:19Z,use_quota=True,user_id='f7402c7483cd445289523f518b68046a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04388d9-a898-4f33-8a06-5177734816bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04388d9-a898-4f33-8a06-5177734816bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0e9c78-0901-472a-9fc7-40f24a65b949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0e9c78-0901-472a-9fc7-40f24a65b949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8af082-36eb-413f-ba5d-0ba1d6f4862c', 'volume_name': 'volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc9dac8-1cbf-4846-a822-33251ad48a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc9dac8-1cbf-4846-a822-33251ad48a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2cc607-a5e9-4df6-9f2a-2ad323746061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:19 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Volume 0b8af082-36eb-413f-ba5d-0ba1d6f4862c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c', 'volume_size': 1} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Flow 'volume_create_manager' (dbb0d81f-50a0-4430-9450-4787e3a208f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c9dc69-e940-4d91-a6f3-126e197a10d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c9dc69-e940-4d91-a6f3-126e197a10d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1276367309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f02d307-14d6-4d28-8322-5e006c24e05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016c476851e6485a87913aea6dde51e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:19Z,use_quota=True,user_id='f7402c7483cd445289523f518b68046a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4c76b7-a890-48f6-bcc2-e46e5cc972a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4c76b7-a890-48f6-bcc2-e46e5cc972a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b4a425-a5bd-4fd4-a8d3-a6fbaee302cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b4a425-a5bd-4fd4-a8d3-a6fbaee302cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f02d307-14d6-4d28-8322-5e006c24e05f', 'volume_name': 'volume-5f02d307-14d6-4d28-8322-5e006c24e05f', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cda6cb5-d19f-4ed8-bfa3-4c1f23472aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cda6cb5-d19f-4ed8-bfa3-4c1f23472aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351ee4cb-fac2-43be-8794-7d3c8135eb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:19 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Volume 5f02d307-14d6-4d28-8322-5e006c24e05f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f02d307-14d6-4d28-8322-5e006c24e05f', 'volume_size': 1} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:19 devstack sudo[114430]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4ff704ae-a42f-41d4-98f7-c15aedbea671 1073741824" returned: 0 in 1.330s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4ff704ae-a42f-41d4-98f7-c15aedbea671 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:19 devstack sudo[114439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4ff704ae-a42f-41d4-98f7-c15aedbea671 Jun 28 14:45:19 devstack sudo[114439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Flow 'volume_create_manager' (16b3b4fd-f84d-4bc4-acf6-ac4f1d6f61dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a23c8c-9073-4479-99c1-43a0ada67bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a23c8c-9073-4479-99c1-43a0ada67bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-886783132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33288cc4-a7bf-47b0-a9d7-92cb059d45ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016c476851e6485a87913aea6dde51e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:20Z,use_quota=True,user_id='f7402c7483cd445289523f518b68046a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0475f02-88f2-423f-844e-e89267e64b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0475f02-88f2-423f-844e-e89267e64b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312550a9-493e-46c2-bffd-58528b392de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312550a9-493e-46c2-bffd-58528b392de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33288cc4-a7bf-47b0-a9d7-92cb059d45ef', 'volume_name': 'volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa85be15-882b-47a8-8779-a3e9b7a805d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa85be15-882b-47a8-8779-a3e9b7a805d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59766bf1-596b-4d6e-837a-96fdf0e8efcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:19 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Volume 33288cc4-a7bf-47b0-a9d7-92cb059d45ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef', 'volume_size': 1} Jun 28 14:45:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:20 devstack sudo[114439]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4ff704ae-a42f-41d4-98f7-c15aedbea671" returned: 0 in 0.738s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.826s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2050629984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b28aaac-c11b-4deb-bd15-fddc847ab1af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e36088d2cdc4222a7538b56934037f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:18Z,use_quota=True,user_id='69e7c7853eeb4288961cdc350961464f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Creating volume 5b28aaac-c11b-4deb-bd15-fddc847ab1af {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:45:20 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c860fcd8-c157-4d43-ab05-066eaee52652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff704ae-a42f-41d4-98f7-c15aedbea671', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d1d1e3-6c0f-484f-a0ea-7cf245415744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:20 devstack sudo[114443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af 1073741824 Jun 28 14:45:20 devstack sudo[114443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:20 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Volume volume-4ff704ae-a42f-41d4-98f7-c15aedbea671 (4ff704ae-a42f-41d4-98f7-c15aedbea671): created successfully Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d1d1e3-6c0f-484f-a0ea-7cf245415744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:20 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Flow 'volume_create_manager' (dff36949-f2ce-46df-8ab4-f5272bfb39b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:20 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-6f5a7261-ecc7-42db-8314-0fcf3c3ce2fd tempest-CreateVolumesFromImageTest-79153278 None] Created volume successfully. Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:21 devstack sudo[114443]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Flow 'volume_create_manager' (d9417106-c122-47a7-baa4-3ec2d5a446e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2e89f4-c88e-4089-9975-c28074f74375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af 1073741824" returned: 0 in 1.075s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2e89f4-c88e-4089-9975-c28074f74375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68dcae3a-0f88-4e5a-94ad-b63cc979dd6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4043576de590475699bd5dbcae682952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:21Z,use_quota=True,user_id='1d0c368536bb40b88d59b7dd0b6c9f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e4fd4b8-592d-4297-97c7-7db942f0ad0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e4fd4b8-592d-4297-97c7-7db942f0ad0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a60733-cb29-4e15-865a-797ae1165619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG cinder.image.glance [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Creating Keystone auth plugin from conf {{(pid=93561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:21 devstack sudo[114454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af Jun 28 14:45:21 devstack sudo[114454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a60733-cb29-4e15-865a-797ae1165619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '68dcae3a-0f88-4e5a-94ad-b63cc979dd6f', 'volume_name': 'volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f', 'volume_size': 1, 'image_id': '978504b9-5a87-423f-a624-c652de346de6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/978504b9-5a87-423f-a624-c652de346de6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9880528bf0838478458fd96ba5b6cc0f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4043576de590475699bd5dbcae682952', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '06602b92e9c589ae45683183470ed5ef49bf3b5c84ef02f0dee993662a5666b655815b0978213b1a425be33edef82a1dc41feef24f46e34046ed723d67d7ea79', 'id': '978504b9-5a87-423f-a624-c652de346de6', 'created_at': datetime.datetime(2026, 6, 28, 12, 45, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 45, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/978504b9-5a87-423f-a624-c652de346de6/file', 'properties': {}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4985f178-66a6-4474-8297-f4058d6a04cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4985f178-66a6-4474-8297-f4058d6a04cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba85565-9212-475a-b90c-4edae1e15429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:21 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Volume 68dcae3a-0f88-4e5a-94ad-b63cc979dd6f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f', 'volume_size': 1, 'image_id': '978504b9-5a87-423f-a624-c652de346de6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/978504b9-5a87-423f-a624-c652de346de6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9880528bf0838478458fd96ba5b6cc0f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4043576de590475699bd5dbcae682952', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '06602b92e9c589ae45683183470ed5ef49bf3b5c84ef02f0dee993662a5666b655815b0978213b1a425be33edef82a1dc41feef24f46e34046ed723d67d7ea79', 'id': '978504b9-5a87-423f-a624-c652de346de6', 'created_at': datetime.datetime(2026, 6, 28, 12, 45, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 45, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/978504b9-5a87-423f-a624-c652de346de6/file', 'properties': {}}, 'image_service': } Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Trying to clone 68dcae3a-0f88-4e5a-94ad-b63cc979dd6f from image 978504b9-5a87-423f-a624-c652de346de6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/978504b9-5a87-423f-a624-c652de346de6', 'metadata': {}}]). {{(pid=93561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 28 14:45:21 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 28 14:45:21 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Image download 0.00 MB at 0.00 MB/s Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00b8b3e-d06a-4905-b4e5-eb304834b149]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:22 devstack sudo[114456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD Jun 28 14:45:22 devstack sudo[114456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:22 devstack sudo[114454]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af" returned: 0 in 0.706s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.480s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1772118094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c85e20-6ae6-42ee-8804-65265b9d727a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016c476851e6485a87913aea6dde51e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:19Z,use_quota=True,user_id='f7402c7483cd445289523f518b68046a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Creating volume 57c85e20-6ae6-42ee-8804-65265b9d727a {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:45:22 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-57c85e20-6ae6-42ee-8804-65265b9d727a 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:22 devstack sudo[114459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-57c85e20-6ae6-42ee-8804-65265b9d727a 1073741824 Jun 28 14:45:22 devstack sudo[114459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f586f11-f0f4-4536-9bcd-eddeb105c3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2e3861-df4f-4827-831c-37db0d19cf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Flow 'volume_create_manager' (3b28fe47-a7f3-44be-b3a0-1ee279e439e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4928a675-8113-4152-bb00-05d36e5ee2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4928a675-8113-4152-bb00-05d36e5ee2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab14b87a-d936-4e1c-b89f-cd2fb5a16a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c760418db84b73aae997ef71320621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:22Z,use_quota=True,user_id='023c502b77c84b488b1f3b39fdd57815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b08a73b-7e0f-4cf3-85aa-367abe866078),volume_type_id=2b08a73b-7e0f-4cf3-85aa-367abe866078)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da5a88d-399e-48b9-9202-72a340380b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da5a88d-399e-48b9-9202-72a340380b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f2bd30-2e9c-4ebf-9f7b-c76b834d2b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.image.glance [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Creating Keystone auth plugin from conf {{(pid=93561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 28 14:45:22 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af (5b28aaac-c11b-4deb-bd15-fddc847ab1af): created successfully Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2e3861-df4f-4827-831c-37db0d19cf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Flow 'volume_create_manager' (5f7c9a49-5833-452c-8c26-20b64c2bc5c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:22 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-8cfcb213-3362-423b-a128-60678f770827 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Created volume successfully. Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f2bd30-2e9c-4ebf-9f7b-c76b834d2b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ab14b87a-d936-4e1c-b89f-cd2fb5a16a91', 'volume_name': 'volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91', 'volume_size': 1, 'image_id': '44535694-0019-4a62-bf13-39f44dd224ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44535694-0019-4a62-bf13-39f44dd224ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1333b8fc1cec370736b7f7611b892aab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '68c760418db84b73aae997ef71320621', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb07e9865b7e40e55fa5683822b05cff57be4dfe38f5df6cd349a3022b8a0fb514d92ee79977ebcff1f1c124fd6ced2f951ebf9e1076c6a03925b65543ffd0a3', 'id': '44535694-0019-4a62-bf13-39f44dd224ea', 'created_at': datetime.datetime(2026, 6, 28, 12, 45, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 45, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44535694-0019-4a62-bf13-39f44dd224ea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f858316d-cfa3-4174-ac07-f5a4d2045b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f858316d-cfa3-4174-ac07-f5a4d2045b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4fdb6e-3a67-46a7-95b6-2e57fc37fe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:22 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Volume ab14b87a-d936-4e1c-b89f-cd2fb5a16a91: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91', 'volume_size': 1, 'image_id': '44535694-0019-4a62-bf13-39f44dd224ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44535694-0019-4a62-bf13-39f44dd224ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1333b8fc1cec370736b7f7611b892aab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '68c760418db84b73aae997ef71320621', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb07e9865b7e40e55fa5683822b05cff57be4dfe38f5df6cd349a3022b8a0fb514d92ee79977ebcff1f1c124fd6ced2f951ebf9e1076c6a03925b65543ffd0a3', 'id': '44535694-0019-4a62-bf13-39f44dd224ea', 'created_at': datetime.datetime(2026, 6, 28, 12, 45, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 45, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44535694-0019-4a62-bf13-39f44dd224ea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Trying to clone ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 from image 44535694-0019-4a62-bf13-39f44dd224ea at location (None, [{'url': 'file:///opt/stack/data/glance/images/44535694-0019-4a62-bf13-39f44dd224ea', 'metadata': {}}]). {{(pid=93561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 28 14:45:22 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Image download 0.00 MB at 0.00 MB/s Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0932a7-93c3-420d-b060-9cedac34911e]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:22 devstack sudo[114456]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD" returned: 0 in 0.802s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:22 devstack sudo[114462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD Jun 28 14:45:22 devstack sudo[114462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:22 devstack sudo[114467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD Jun 28 14:45:22 devstack sudo[114467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:23 devstack sudo[114459]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-57c85e20-6ae6-42ee-8804-65265b9d727a 1073741824" returned: 0 in 0.908s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-57c85e20-6ae6-42ee-8804-65265b9d727a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:23 devstack sudo[114471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-57c85e20-6ae6-42ee-8804-65265b9d727a Jun 28 14:45:23 devstack sudo[114471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:23 devstack sudo[114462]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD" returned: 0 in 0.819s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:23 devstack sudo[114475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD Jun 28 14:45:23 devstack sudo[114475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:23 devstack sudo[114467]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD" returned: 1 in 0.900s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:45:23 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Temporary image 978504b9-5a87-423f-a624-c652de346de6 is fetched for user 1d0c368536bb40b88d59b7dd0b6c9f11. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 28 14:45:23 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[688dae0b-15c5-44a8-a9dc-b2089be291fe]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:23 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Flow 'volume_create_manager' (63b30a2c-c610-4643-b852-9b4b91eb48a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81b3034-532a-4cb1-ae16-f048f0fc2e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81b3034-532a-4cb1-ae16-f048f0fc2e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-847467315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b5a332-b869-4a4c-818e-6e55e6bc0e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e36088d2cdc4222a7538b56934037f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:24Z,use_quota=True,user_id='69e7c7853eeb4288961cdc350961464f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9990c03-6d36-4b40-9f03-2a15228faf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9990c03-6d36-4b40-9f03-2a15228faf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270cee9b-a400-4469-a8ce-285a3e82f0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270cee9b-a400-4469-a8ce-285a3e82f0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1b5a332-b869-4a4c-818e-6e55e6bc0e50', 'volume_name': 'volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d09b423-f37a-482c-a23a-7c31791c95f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d09b423-f37a-482c-a23a-7c31791c95f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b45e0c0-823d-46df-8dd5-143adcbfc301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume a1b5a332-b869-4a4c-818e-6e55e6bc0e50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50', 'volume_size': 1} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:24 devstack sudo[114480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD Jun 28 14:45:24 devstack sudo[114480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:24 devstack sudo[114471]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-57c85e20-6ae6-42ee-8804-65265b9d727a" returned: 0 in 0.970s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.073s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-203998051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8af082-36eb-413f-ba5d-0ba1d6f4862c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016c476851e6485a87913aea6dde51e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:19Z,use_quota=True,user_id='f7402c7483cd445289523f518b68046a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Creating volume 0b8af082-36eb-413f-ba5d-0ba1d6f4862c {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:45:24 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:24 devstack sudo[114483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c 1073741824 Jun 28 14:45:24 devstack sudo[114483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d318644d-18f0-45ee-b8ca-7e0a189f8933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c85e20-6ae6-42ee-8804-65265b9d727a', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3767c9bc-98de-43ea-a3ff-5f04e0b5dfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Volume volume-57c85e20-6ae6-42ee-8804-65265b9d727a (57c85e20-6ae6-42ee-8804-65265b9d727a): created successfully Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3767c9bc-98de-43ea-a3ff-5f04e0b5dfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Flow 'volume_create_manager' (c753039d-1b3a-4eb5-b241-c8601dc97187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Flow 'volume_create_manager' (722633ee-801b-4d25-a1d7-975d6e088555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de877bf2-8636-446d-9025-c0ca53862b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7fb5ff20-979b-473b-a391-e86762ca307b tempest-CreateVolumesFromImageTest-79153278 None] Created volume successfully. Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de877bf2-8636-446d-9025-c0ca53862b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-662168817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6004e6cd-c779-4789-9e09-bd20cddae019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e36088d2cdc4222a7538b56934037f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:24Z,use_quota=True,user_id='69e7c7853eeb4288961cdc350961464f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bf04b6-2517-4b60-b931-da2d8d5b03b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bf04b6-2517-4b60-b931-da2d8d5b03b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140c62b7-6a8c-4421-a546-b82fbb0bfe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140c62b7-6a8c-4421-a546-b82fbb0bfe8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6004e6cd-c779-4789-9e09-bd20cddae019', 'volume_name': 'volume-6004e6cd-c779-4789-9e09-bd20cddae019', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4721a8fb-ec77-4309-a858-1fc62e7fc77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4721a8fb-ec77-4309-a858-1fc62e7fc77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1436d194-8584-444e-ad1b-a2dcdf69bde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume 6004e6cd-c779-4789-9e09-bd20cddae019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6004e6cd-c779-4789-9e09-bd20cddae019', 'volume_size': 1} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:24 devstack sudo[114475]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Flow 'volume_create_manager' (862db96c-2be2-4f54-bc4c-21a908d155a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001a26b8-f258-4b9c-9c3a-ffecc8ba69b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD" returned: 1 in 1.259s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Temporary image 44535694-0019-4a62-bf13-39f44dd224ea is fetched for user 023c502b77c84b488b1f3b39fdd57815. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001a26b8-f258-4b9c-9c3a-ffecc8ba69b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-265107567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e36088d2cdc4222a7538b56934037f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:25Z,use_quota=True,user_id='69e7c7853eeb4288961cdc350961464f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f68ef9b-c217-4335-8636-dc50143d2e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f68ef9b-c217-4335-8636-dc50143d2e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfa4cea-3b7c-4e38-a244-0404fad51ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfa4cea-3b7c-4e38-a244-0404fad51ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3', 'volume_name': 'volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d78d95-438a-42d8-872b-a57f023eb330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d78d95-438a-42d8-872b-a57f023eb330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c8538a-ebee-4a82-afcd-d3452ed51711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:24 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume 2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3', 'volume_size': 1} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[464c9b55-d377-4ab4-8505-d6bcb560fc20]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:25 devstack sudo[114480]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD" returned: 0 in 1.160s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:25 devstack sudo[114492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD Jun 28 14:45:25 devstack sudo[114492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:25 devstack sudo[114495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD Jun 28 14:45:25 devstack sudo[114495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:25 devstack sudo[114483]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c 1073741824" returned: 0 in 1.166s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:25 devstack sudo[114498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c Jun 28 14:45:25 devstack sudo[114498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Flow 'volume_create_manager' (6d80b35f-d765-4997-b2fd-3dff0c4b8739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848cf2f9-9209-4479-a5f6-95ab28dd53c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848cf2f9-9209-4479-a5f6-95ab28dd53c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-377660005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16fe8c12-27bb-4454-8f25-4204171539c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e36088d2cdc4222a7538b56934037f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:25Z,use_quota=True,user_id='69e7c7853eeb4288961cdc350961464f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed654026-69f0-46b2-88f7-5f33ad9dde0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed654026-69f0-46b2-88f7-5f33ad9dde0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc6cb4e-f4f4-4fae-83fa-81fa5a4e92bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc6cb4e-f4f4-4fae-83fa-81fa5a4e92bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16fe8c12-27bb-4454-8f25-4204171539c3', 'volume_name': 'volume-16fe8c12-27bb-4454-8f25-4204171539c3', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6a3002-3729-455c-9f2a-595e2df58810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6a3002-3729-455c-9f2a-595e2df58810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f7975c-09c8-4ed8-9000-7f175d3608e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:25 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume 16fe8c12-27bb-4454-8f25-4204171539c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16fe8c12-27bb-4454-8f25-4204171539c3', 'volume_size': 1} Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:25 devstack sudo[114492]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD" returned: 0 in 0.933s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:25 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Flow 'volume_create_manager' (a8877706-c6b4-4aaf-bcc8-7cd5990a2cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1af93d-5227-47f8-847c-c74cd6e7ece3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:26 devstack sudo[114502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD Jun 28 14:45:26 devstack sudo[114502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:26 devstack sudo[114495]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1af93d-5227-47f8-847c-c74cd6e7ece3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1312960163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9da994-3347-4bf3-81ff-c63847f97cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e36088d2cdc4222a7538b56934037f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:26Z,use_quota=True,user_id='69e7c7853eeb4288961cdc350961464f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298d6b21-f55c-44db-b0b2-07d7c7172ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298d6b21-f55c-44db-b0b2-07d7c7172ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6308ea50-4607-4488-9fea-8a8a6f2b5a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6308ea50-4607-4488-9fea-8a8a6f2b5a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce9da994-3347-4bf3-81ff-c63847f97cce', 'volume_name': 'volume-ce9da994-3347-4bf3-81ff-c63847f97cce', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e7ecc5-e041-4078-90b7-aa774379e828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e7ecc5-e041-4078-90b7-aa774379e828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f6629d-bdc4-41d8-b597-79deb1147c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:26 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume ce9da994-3347-4bf3-81ff-c63847f97cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce9da994-3347-4bf3-81ff-c63847f97cce', 'volume_size': 1} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD" returned: 1 in 1.037s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:26 devstack sudo[114498]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c" returned: 0 in 0.855s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.897s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1276367309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f02d307-14d6-4d28-8322-5e006c24e05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016c476851e6485a87913aea6dde51e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:19Z,use_quota=True,user_id='f7402c7483cd445289523f518b68046a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Creating volume 5f02d307-14d6-4d28-8322-5e006c24e05f {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:45:26 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5f02d307-14d6-4d28-8322-5e006c24e05f 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2cc607-a5e9-4df6-9f2a-2ad323746061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:26 devstack sudo[114508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5f02d307-14d6-4d28-8322-5e006c24e05f 1073741824 Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b8ff20-2724-4d33-88b5-5c60eb6638c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:26 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:26 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Volume volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c (0b8af082-36eb-413f-ba5d-0ba1d6f4862c): created successfully Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b8ff20-2724-4d33-88b5-5c60eb6638c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Flow 'volume_create_manager' (74d14508-9fae-46b7-914c-d6825d8d6f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:26 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-6b160e48-d0d7-47d0-a0cc-7dbff7e3d87b tempest-CreateVolumesFromImageTest-79153278 None] Created volume successfully. Jun 28 14:45:26 devstack sudo[114502]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD" returned: 1 in 0.781s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:45:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:27 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5f02d307-14d6-4d28-8322-5e006c24e05f 1073741824" returned: 0 in 0.811s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5f02d307-14d6-4d28-8322-5e006c24e05f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:27 devstack sudo[114517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5f02d307-14d6-4d28-8322-5e006c24e05f Jun 28 14:45:27 devstack sudo[114517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:27 devstack sudo[114517]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5f02d307-14d6-4d28-8322-5e006c24e05f" returned: 0 in 0.637s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.958s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-886783132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33288cc4-a7bf-47b0-a9d7-92cb059d45ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016c476851e6485a87913aea6dde51e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:20Z,use_quota=True,user_id='f7402c7483cd445289523f518b68046a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Creating volume 33288cc4-a7bf-47b0-a9d7-92cb059d45ef {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:45:27 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:27 devstack sudo[114520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef 1073741824 Jun 28 14:45:27 devstack sudo[114520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351ee4cb-fac2-43be-8794-7d3c8135eb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f02d307-14d6-4d28-8322-5e006c24e05f', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb887a6-b79f-46c0-b7d6-2f80635a5cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:27 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Volume volume-5f02d307-14d6-4d28-8322-5e006c24e05f (5f02d307-14d6-4d28-8322-5e006c24e05f): created successfully Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb887a6-b79f-46c0-b7d6-2f80635a5cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:27 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Flow 'volume_create_manager' (dbb0d81f-50a0-4430-9450-4787e3a208f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:27 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-02ae1047-db08-4118-adbe-9f80d937b238 tempest-CreateVolumesFromImageTest-79153278 None] Created volume successfully. Jun 28 14:45:28 devstack sudo[114520]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef 1073741824" returned: 0 in 0.798s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:28 devstack sudo[114526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef Jun 28 14:45:28 devstack sudo[114526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:29 devstack sudo[114526]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef" returned: 0 in 0.634s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.225s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-847467315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b5a332-b869-4a4c-818e-6e55e6bc0e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e36088d2cdc4222a7538b56934037f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:24Z,use_quota=True,user_id='69e7c7853eeb4288961cdc350961464f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Creating volume a1b5a332-b869-4a4c-818e-6e55e6bc0e50 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:45:29 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59766bf1-596b-4d6e-837a-96fdf0e8efcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:29 devstack sudo[114529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50 1073741824 Jun 28 14:45:29 devstack sudo[114529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107ede3b-597f-4923-abef-cd55bb393544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:29 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Volume volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef (33288cc4-a7bf-47b0-a9d7-92cb059d45ef): created successfully Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107ede3b-597f-4923-abef-cd55bb393544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Flow 'volume_create_manager' (16b3b4fd-f84d-4bc4-acf6-ac4f1d6f61dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:29 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-69c27768-89b3-4a32-8173-77387f4aa932 tempest-CreateVolumesFromImageTest-79153278 None] Created volume successfully. Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "cinder-33288cc4-a7bf-47b0-a9d7-92cb059d45ef-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-33288cc4-a7bf-47b0-a9d7-92cb059d45ef-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "cinder-quobyte-33288cc4-a7bf-47b0-a9d7-92cb059d45ef" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-quobyte-33288cc4-a7bf-47b0-a9d7-92cb059d45ef" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e811cdf-0216-4260-a169-cbabd198d8ff]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:29 devstack sudo[114531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef Jun 28 14:45:29 devstack sudo[114531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:30 devstack sudo[114529]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50 1073741824" returned: 0 in 0.831s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:30 devstack sudo[114536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50 Jun 28 14:45:30 devstack sudo[114536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:30 devstack sudo[114531]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef" returned: 0 in 0.800s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:30 devstack sudo[114542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef Jun 28 14:45:30 devstack sudo[114542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:30 devstack sudo[114536]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50" returned: 0 in 0.651s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.336s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-662168817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6004e6cd-c779-4789-9e09-bd20cddae019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e36088d2cdc4222a7538b56934037f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:24Z,use_quota=True,user_id='69e7c7853eeb4288961cdc350961464f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Creating volume 6004e6cd-c779-4789-9e09-bd20cddae019 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:45:30 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6004e6cd-c779-4789-9e09-bd20cddae019 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b45e0c0-823d-46df-8dd5-143adcbfc301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:30 devstack sudo[114545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6004e6cd-c779-4789-9e09-bd20cddae019 1073741824 Jun 28 14:45:30 devstack sudo[114545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ee6d4c-055b-474a-bd13-77156d26424b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:30 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50 (a1b5a332-b869-4a4c-818e-6e55e6bc0e50): created successfully Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ee6d4c-055b-474a-bd13-77156d26424b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:30 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Flow 'volume_create_manager' (63b30a2c-c610-4643-b852-9b4b91eb48a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:30 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-8b234eee-05fe-4b48-ac1f-ebfeeabcb520 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Created volume successfully. Jun 28 14:45:31 devstack sudo[114542]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-33288cc4-a7bf-47b0-a9d7-92cb059d45ef" returned: 0 in 0.646s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-quobyte-33288cc4-a7bf-47b0-a9d7-92cb059d45ef" released by "delete_volume" :: held 1.492s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Created reservations ['a018e344-6edf-48fb-a034-c419289eddb6', 'b796f569-2007-411c-b3da-d2578b0c863b', 'b459a964-9c1a-4a2b-aaf4-78be2b2bbc39', 'e74cf032-b48a-44d5-8a96-877fd5c11e2d'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:31 devstack sudo[114548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:45:31 devstack sudo[114548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:31 devstack sudo[114545]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6004e6cd-c779-4789-9e09-bd20cddae019 1073741824" returned: 0 in 0.845s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6004e6cd-c779-4789-9e09-bd20cddae019 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:31 devstack sudo[114553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6004e6cd-c779-4789-9e09-bd20cddae019 Jun 28 14:45:31 devstack sudo[114553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "cinder-5f02d307-14d6-4d28-8322-5e006c24e05f-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-5f02d307-14d6-4d28-8322-5e006c24e05f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "cinder-quobyte-5f02d307-14d6-4d28-8322-5e006c24e05f" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-quobyte-5f02d307-14d6-4d28-8322-5e006c24e05f" acquired by "delete_volume" :: waited 0.028s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39e1ac7-a351-48d3-8d11-374b245722fd]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5f02d307-14d6-4d28-8322-5e006c24e05f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:31 devstack sudo[114548]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.755s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:31 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:45:31 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Deleted volume successfully. Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-790ec038-9bc0-4850-a140-8a1178bacdef tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-33288cc4-a7bf-47b0-a9d7-92cb059d45ef-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:32 devstack sudo[114556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5f02d307-14d6-4d28-8322-5e006c24e05f Jun 28 14:45:32 devstack sudo[114556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:32 devstack sudo[114553]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6004e6cd-c779-4789-9e09-bd20cddae019" returned: 0 in 0.703s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.513s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-265107567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e36088d2cdc4222a7538b56934037f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:25Z,use_quota=True,user_id='69e7c7853eeb4288961cdc350961464f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Creating volume 2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:45:32 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1436d194-8584-444e-ad1b-a2dcdf69bde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6004e6cd-c779-4789-9e09-bd20cddae019', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:32 devstack sudo[114559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3 1073741824 Jun 28 14:45:32 devstack sudo[114559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76cc721e-9a85-4b0f-b221-2d424b763961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:32 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume volume-6004e6cd-c779-4789-9e09-bd20cddae019 (6004e6cd-c779-4789-9e09-bd20cddae019): created successfully Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76cc721e-9a85-4b0f-b221-2d424b763961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Flow 'volume_create_manager' (722633ee-801b-4d25-a1d7-975d6e088555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:32 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-d842a990-892f-4d60-95f7-8f99d6ba5c5f tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Created volume successfully. Jun 28 14:45:32 devstack sudo[114556]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5f02d307-14d6-4d28-8322-5e006c24e05f" returned: 0 in 0.804s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5f02d307-14d6-4d28-8322-5e006c24e05f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:32 devstack sudo[114564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5f02d307-14d6-4d28-8322-5e006c24e05f Jun 28 14:45:32 devstack sudo[114564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:33 devstack sudo[114559]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3 1073741824" returned: 0 in 0.845s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:33 devstack sudo[114570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3 Jun 28 14:45:33 devstack sudo[114570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:33 devstack sudo[114564]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5f02d307-14d6-4d28-8322-5e006c24e05f" returned: 0 in 0.684s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-quobyte-5f02d307-14d6-4d28-8322-5e006c24e05f" released by "delete_volume" :: held 1.532s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Created reservations ['28f8426d-2adc-418b-b1a5-f11ef976ee22', 'a5b6de26-1e3c-457e-bb51-3ed3d93bfd1a', 'e71b1a73-0a47-4f2e-b740-c75932dd6c20', '328de870-501d-4480-b647-2e1f525deda7'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:33 devstack sudo[114572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:45:33 devstack sudo[114572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:33 devstack sudo[114570]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3" returned: 0 in 0.669s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.367s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-377660005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16fe8c12-27bb-4454-8f25-4204171539c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e36088d2cdc4222a7538b56934037f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:25Z,use_quota=True,user_id='69e7c7853eeb4288961cdc350961464f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Creating volume 16fe8c12-27bb-4454-8f25-4204171539c3 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:33 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:45:34 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16fe8c12-27bb-4454-8f25-4204171539c3 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c8538a-ebee-4a82-afcd-d3452ed51711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:34 devstack sudo[114575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16fe8c12-27bb-4454-8f25-4204171539c3 1073741824 Jun 28 14:45:34 devstack sudo[114575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0d89c9-c5f4-4180-95b3-33e221d1bc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:34 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3 (2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3): created successfully Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0d89c9-c5f4-4180-95b3-33e221d1bc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Flow 'volume_create_manager' (862db96c-2be2-4f54-bc4c-21a908d155a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "cinder-0b8af082-36eb-413f-ba5d-0ba1d6f4862c-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:34 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-22103844-7c9a-4bcd-bd30-4951012d2dca tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Created volume successfully. Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-0b8af082-36eb-413f-ba5d-0ba1d6f4862c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "cinder-quobyte-0b8af082-36eb-413f-ba5d-0ba1d6f4862c" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-quobyte-0b8af082-36eb-413f-ba5d-0ba1d6f4862c" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba23bf36-51ac-44ac-b11c-39290e584b00]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:34 devstack sudo[114572]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.721s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:45:34 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Deleted volume successfully. Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-552a31ca-77bb-4380-9dcd-3671357ff0d9 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-5f02d307-14d6-4d28-8322-5e006c24e05f-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:34 devstack sudo[114578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c Jun 28 14:45:34 devstack sudo[114578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:34 devstack sudo[114575]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16fe8c12-27bb-4454-8f25-4204171539c3 1073741824" returned: 0 in 0.860s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16fe8c12-27bb-4454-8f25-4204171539c3 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:34 devstack sudo[114586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16fe8c12-27bb-4454-8f25-4204171539c3 Jun 28 14:45:34 devstack sudo[114586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:35 devstack sudo[114578]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c" returned: 0 in 0.814s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:35 devstack sudo[114588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c Jun 28 14:45:35 devstack sudo[114588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:35 devstack sudo[114586]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16fe8c12-27bb-4454-8f25-4204171539c3" returned: 0 in 0.661s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.511s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1312960163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9da994-3347-4bf3-81ff-c63847f97cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e36088d2cdc4222a7538b56934037f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:26Z,use_quota=True,user_id='69e7c7853eeb4288961cdc350961464f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Creating volume ce9da994-3347-4bf3-81ff-c63847f97cce {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:45:35 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce9da994-3347-4bf3-81ff-c63847f97cce 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:35 devstack sudo[114591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce9da994-3347-4bf3-81ff-c63847f97cce 1073741824 Jun 28 14:45:35 devstack sudo[114591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f7975c-09c8-4ed8-9000-7f175d3608e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16fe8c12-27bb-4454-8f25-4204171539c3', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e692d43c-0d33-4e46-a6f3-27b191eb4797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:35 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume volume-16fe8c12-27bb-4454-8f25-4204171539c3 (16fe8c12-27bb-4454-8f25-4204171539c3): created successfully Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e692d43c-0d33-4e46-a6f3-27b191eb4797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Flow 'volume_create_manager' (6d80b35f-d765-4997-b2fd-3dff0c4b8739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:35 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7ca2143d-4d33-47f0-aa0d-db991e0668e6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Created volume successfully. Jun 28 14:45:35 devstack sudo[114588]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-0b8af082-36eb-413f-ba5d-0ba1d6f4862c" returned: 0 in 0.699s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-quobyte-0b8af082-36eb-413f-ba5d-0ba1d6f4862c" released by "delete_volume" :: held 1.554s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Created reservations ['448d6b26-b263-4a25-baaf-1d09b8c4df3b', '6a06f1b2-c950-4f0c-8e45-331de5290d15', 'd0d76471-bfda-4a43-8e97-0405ee906437', '5f20e61e-ce4f-4681-ad31-4dfd5272e399'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:35 devstack sudo[114594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:45:35 devstack sudo[114594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "cinder-57c85e20-6ae6-42ee-8804-65265b9d727a-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-57c85e20-6ae6-42ee-8804-65265b9d727a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "cinder-quobyte-57c85e20-6ae6-42ee-8804-65265b9d727a" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-quobyte-57c85e20-6ae6-42ee-8804-65265b9d727a" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:36 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ac7b77-d65c-4147-9b45-65d1d0fe6f78]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-57c85e20-6ae6-42ee-8804-65265b9d727a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:36 devstack sudo[114591]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce9da994-3347-4bf3-81ff-c63847f97cce 1073741824" returned: 0 in 0.925s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:36 devstack sudo[114594]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.661s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:36 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:45:36 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Deleted volume successfully. Jun 28 14:45:36 devstack sudo[114601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-57c85e20-6ae6-42ee-8804-65265b9d727a Jun 28 14:45:36 devstack sudo[114601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6447b3ad-d0c8-4094-9991-bbd7bd88dc56 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-0b8af082-36eb-413f-ba5d-0ba1d6f4862c-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce9da994-3347-4bf3-81ff-c63847f97cce {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:36 devstack sudo[114603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce9da994-3347-4bf3-81ff-c63847f97cce Jun 28 14:45:36 devstack sudo[114603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:37 devstack sudo[114601]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-57c85e20-6ae6-42ee-8804-65265b9d727a" returned: 0 in 0.761s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-57c85e20-6ae6-42ee-8804-65265b9d727a {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:37 devstack sudo[114609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-57c85e20-6ae6-42ee-8804-65265b9d727a Jun 28 14:45:37 devstack sudo[114609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:37 devstack sudo[114603]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce9da994-3347-4bf3-81ff-c63847f97cce" returned: 0 in 0.670s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.179s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68dcae3a-0f88-4e5a-94ad-b63cc979dd6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4043576de590475699bd5dbcae682952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:21Z,use_quota=True,user_id='1d0c368536bb40b88d59b7dd0b6c9f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Creating volume 68dcae3a-0f88-4e5a-94ad-b63cc979dd6f {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:45:37 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f6629d-bdc4-41d8-b597-79deb1147c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce9da994-3347-4bf3-81ff-c63847f97cce', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e20d81-4cfb-4963-9aa0-9f66b6be64b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:37 devstack sudo[114611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f 1073741824 Jun 28 14:45:37 devstack sudo[114611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:37 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Volume volume-ce9da994-3347-4bf3-81ff-c63847f97cce (ce9da994-3347-4bf3-81ff-c63847f97cce): created successfully Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e20d81-4cfb-4963-9aa0-9f66b6be64b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Flow 'volume_create_manager' (a8877706-c6b4-4aaf-bcc8-7cd5990a2cb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:37 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-87a51f1f-2a42-44e2-8926-81e01fafe196 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Created volume successfully. Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "cinder-ce9da994-3347-4bf3-81ff-c63847f97cce-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-ce9da994-3347-4bf3-81ff-c63847f97cce-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "cinder-quobyte-ce9da994-3347-4bf3-81ff-c63847f97cce" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:37 devstack sudo[114617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:45:37 devstack sudo[114617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:37 devstack sudo[114609]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-quobyte-ce9da994-3347-4bf3-81ff-c63847f97cce" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-57c85e20-6ae6-42ee-8804-65265b9d727a" returned: 0 in 0.727s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-quobyte-57c85e20-6ae6-42ee-8804-65265b9d727a" released by "delete_volume" :: held 1.528s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b409b3-4beb-49ac-8de1-f9dd6ee858fc]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce9da994-3347-4bf3-81ff-c63847f97cce {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Created reservations ['1d5584b2-90bd-4909-a97e-2fbc984f4b3f', '97e6a324-c853-4cd6-8d82-fdf1f8836971', '6e90aeb9-67bb-468e-a552-93d684507e1b', '9ef29679-5a08-4120-b1e5-5c5e17cabbce'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:45:38 devstack sudo[114619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce9da994-3347-4bf3-81ff-c63847f97cce Jun 28 14:45:38 devstack sudo[114619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:38 devstack sudo[114622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:45:38 devstack sudo[114622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:38 devstack sudo[114611]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f 1073741824" returned: 0 in 0.936s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:38 devstack sudo[114624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f Jun 28 14:45:38 devstack sudo[114624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "cinder-4ff704ae-a42f-41d4-98f7-c15aedbea671-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-4ff704ae-a42f-41d4-98f7-c15aedbea671-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "cinder-quobyte-4ff704ae-a42f-41d4-98f7-c15aedbea671" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-quobyte-4ff704ae-a42f-41d4-98f7-c15aedbea671" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d8f067-eb2e-4dee-97af-db74917d7a46]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4ff704ae-a42f-41d4-98f7-c15aedbea671 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:38 devstack sudo[114617]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.919s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 28 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:45:38 devstack sudo[114622]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.719s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:45:38 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Deleted volume successfully. Jun 28 14:45:38 devstack sudo[114628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4ff704ae-a42f-41d4-98f7-c15aedbea671 Jun 28 14:45:38 devstack sudo[114628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:38 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-cfddc92d-abda-4d9e-9822-3d4884e2cff3 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-57c85e20-6ae6-42ee-8804-65265b9d727a-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:39 devstack sudo[114624]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f" returned: 0 in 0.781s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.370s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab14b87a-d936-4e1c-b89f-cd2fb5a16a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c760418db84b73aae997ef71320621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:22Z,use_quota=True,user_id='023c502b77c84b488b1f3b39fdd57815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b08a73b-7e0f-4cf3-85aa-367abe866078),volume_type_id=2b08a73b-7e0f-4cf3-85aa-367abe866078)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Creating volume ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:45:39 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:39 devstack sudo[114619]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce9da994-3347-4bf3-81ff-c63847f97cce" returned: 0 in 1.128s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce9da994-3347-4bf3-81ff-c63847f97cce {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:39 devstack sudo[114634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 1073741824 Jun 28 14:45:39 devstack sudo[114634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:39 devstack sudo[114636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce9da994-3347-4bf3-81ff-c63847f97cce Jun 28 14:45:39 devstack sudo[114636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Attempting download of 978504b9-5a87-423f-a624-c652de346de6 ((None, [{'url': 'file:///opt/stack/data/glance/images/978504b9-5a87-423f-a624-c652de346de6', 'metadata': {}}])) to volume 68dcae3a-0f88-4e5a-94ad-b63cc979dd6f. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a8d561-cb92-43de-850b-8eaad9b1be08]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_978504b9-5a87-423f-a624-c652de346de6_8wbrk5z1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:39 devstack sudo[114638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_978504b9-5a87-423f-a624-c652de346de6_8wbrk5z1 Jun 28 14:45:39 devstack sudo[114638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:39 devstack sudo[114628]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4ff704ae-a42f-41d4-98f7-c15aedbea671" returned: 0 in 0.856s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4ff704ae-a42f-41d4-98f7-c15aedbea671 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:39 devstack sudo[114644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4ff704ae-a42f-41d4-98f7-c15aedbea671 Jun 28 14:45:39 devstack sudo[114644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:39 devstack sudo[114636]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ce9da994-3347-4bf3-81ff-c63847f97cce" returned: 0 in 0.736s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-quobyte-ce9da994-3347-4bf3-81ff-c63847f97cce" released by "delete_volume" :: held 1.915s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Created reservations ['dbf8aff4-c2b4-4b92-b0ff-74a18d511cc7', '9c61e67c-3a68-466f-9ec0-4645cb31ad48', '286c630c-7e84-46d9-bd44-bbee14dc7f7c', '73335bdb-027a-4af3-80dc-9a302abd4740'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:40 devstack sudo[114653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:45:40 devstack sudo[114653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:40 devstack sudo[114638]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_978504b9-5a87-423f-a624-c652de346de6_8wbrk5z1" returned: 0 in 0.906s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_978504b9-5a87-423f-a624-c652de346de6_8wbrk5z1 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:40 devstack sudo[114634]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "cinder-16fe8c12-27bb-4454-8f25-4204171539c3-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 1073741824" returned: 0 in 1.074s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-16fe8c12-27bb-4454-8f25-4204171539c3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:40 devstack sudo[114656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 Jun 28 14:45:40 devstack sudo[114656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "cinder-quobyte-16fe8c12-27bb-4454-8f25-4204171539c3" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-quobyte-16fe8c12-27bb-4454-8f25-4204171539c3" acquired by "delete_volume" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:40 devstack sudo[114655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_978504b9-5a87-423f-a624-c652de346de6_8wbrk5z1 Jun 28 14:45:40 devstack sudo[114655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4551cf6c-1fa7-4a2b-9f97-b44025718fdc]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16fe8c12-27bb-4454-8f25-4204171539c3 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:40 devstack sudo[114660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16fe8c12-27bb-4454-8f25-4204171539c3 Jun 28 14:45:40 devstack sudo[114660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:40 devstack sudo[114644]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4ff704ae-a42f-41d4-98f7-c15aedbea671" returned: 0 in 0.976s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-quobyte-4ff704ae-a42f-41d4-98f7-c15aedbea671" released by "delete_volume" :: held 1.894s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Created reservations ['466fe9c4-edc5-4861-9bcc-d1ff6d8a6c72', '35e82a6a-ca3c-40be-b9d2-835cf8b863b9', '928c3ad2-33aa-4122-a35e-fa3f5f6a0085', '78fc3c2d-c390-42d6-b93a-3d8c9eab905c'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:40 devstack sudo[114653]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.864s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:45:40 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Deleted volume successfully. Jun 28 14:45:40 devstack sudo[114664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:45:40 devstack sudo[114664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:40 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f7f8bcf-662c-4776-a791-bd8f4dabcdd5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-ce9da994-3347-4bf3-81ff-c63847f97cce-delete_volume" released by "delete_volume" :: held 3.079s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:41 devstack sudo[114655]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_978504b9-5a87-423f-a624-c652de346de6_8wbrk5z1" returned: 1 in 1.166s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_978504b9-5a87-423f-a624-c652de346de6_8wbrk5z1' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:45:41 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab01bc01-2800-470f-9fca-9170c2ebf9f3]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:41 devstack sudo[114673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD Jun 28 14:45:41 devstack sudo[114673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:41 devstack sudo[114656]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91" returned: 0 in 1.202s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:41 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] <== create_volume: return (2390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:45:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.393s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:41 devstack sudo[114660]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16fe8c12-27bb-4454-8f25-4204171539c3" returned: 0 in 1.114s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16fe8c12-27bb-4454-8f25-4204171539c3 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:41 devstack sudo[114675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16fe8c12-27bb-4454-8f25-4204171539c3 Jun 28 14:45:41 devstack sudo[114675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:41 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Attempting download of 44535694-0019-4a62-bf13-39f44dd224ea ((None, [{'url': 'file:///opt/stack/data/glance/images/44535694-0019-4a62-bf13-39f44dd224ea', 'metadata': {}}])) to volume ab14b87a-d936-4e1c-b89f-cd2fb5a16a91. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 28 14:45:41 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df2b97b-bef4-429c-bbba-94de0fff9a32]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44535694-0019-4a62-bf13-39f44dd224ea_7nx22z8s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:41 devstack sudo[114664]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.881s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:41 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:45:41 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Deleted volume successfully. Jun 28 14:45:41 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7219b2c6-f52b-4568-a978-49764df301b7 tempest-CreateVolumesFromImageTest-79153278 None] Lock "cinder-4ff704ae-a42f-41d4-98f7-c15aedbea671-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:41 devstack sudo[114678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44535694-0019-4a62-bf13-39f44dd224ea_7nx22z8s Jun 28 14:45:41 devstack sudo[114678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:42 devstack sudo[114673]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:42 devstack sudo[114675]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD" returned: 0 in 0.997s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-16fe8c12-27bb-4454-8f25-4204171539c3" returned: 0 in 0.815s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-quobyte-16fe8c12-27bb-4454-8f25-4204171539c3" released by "delete_volume" :: held 1.994s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:42 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Created reservations ['5eb0c230-a2bc-45ea-9a48-6304bcf69da4', '320eedfc-6bf2-48f5-82f7-461fe1fb88d6', '3f14da36-cb69-4bd3-9ae1-32b8a9b187b1', '9096c6ae-a9f0-4b01-a05c-a8e9f029b01b'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:45:42 devstack sudo[114684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD Jun 28 14:45:42 devstack sudo[114684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:42 devstack sudo[114688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:45:42 devstack sudo[114688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:42 devstack sudo[114678]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44535694-0019-4a62-bf13-39f44dd224ea_7nx22z8s" returned: 0 in 0.930s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44535694-0019-4a62-bf13-39f44dd224ea_7nx22z8s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:42 devstack sudo[114690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44535694-0019-4a62-bf13-39f44dd224ea_7nx22z8s Jun 28 14:45:42 devstack sudo[114690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:43 devstack sudo[114684]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD" returned: 1 in 0.964s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] 978504b9-5a87-423f-a624-c652de346de6 was raw, converting to raw {{(pid=93561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:43 devstack sudo[114697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f Jun 28 14:45:43 devstack sudo[114697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:43 devstack sudo[114688]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.858s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:45:43 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Deleted volume successfully. Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e0509142-4af6-47b4-9cd6-aa1b4706e62b tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-16fe8c12-27bb-4454-8f25-4204171539c3-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:43 devstack sudo[114690]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44535694-0019-4a62-bf13-39f44dd224ea_7nx22z8s" returned: 1 in 0.884s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44535694-0019-4a62-bf13-39f44dd224ea_7nx22z8s' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e182fa-b8a5-4177-9517-f3bb5b36c45d]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "cinder-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:43 devstack sudo[114701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD Jun 28 14:45:43 devstack sudo[114701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "cinder-quobyte-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-quobyte-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[52974898-5166-4bdc-9613-0db898737edf]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:43 devstack sudo[114703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3 Jun 28 14:45:43 devstack sudo[114703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:44 devstack sudo[114697]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f" returned: 0 in 0.907s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_978504b9-5a87-423f-a624-c652de346de6_rlbyaxa0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:45:44 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Converted 0.00 MB image at 0.00 MB/s Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:44 devstack sudo[114708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f 1G Jun 28 14:45:44 devstack sudo[114708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:44 devstack sudo[114701]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD" returned: 0 in 0.894s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:44 devstack sudo[114712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD Jun 28 14:45:44 devstack sudo[114712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:44 devstack sudo[114703]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3" returned: 0 in 0.930s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:44 devstack sudo[114718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3 Jun 28 14:45:44 devstack sudo[114718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Flow 'volume_create_manager' (5ce07745-a411-46aa-b92d-36cb5307d7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ecc0f6-e8c9-4be2-a0da-359df770d7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ecc0f6-e8c9-4be2-a0da-359df770d7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1449785490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321715ec-8c3d-46ac-a0df-2c70c8b0de92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b0c708591b44d69a2eb570ec3facb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:45Z,use_quota=True,user_id='9e09cf9cb777417fa2c7a89ae948d558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e8e8a9-197f-4936-8688-002bcbc06336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e8e8a9-197f-4936-8688-002bcbc06336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35363f92-f689-4305-bd8e-5f8a654d6544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35363f92-f689-4305-bd8e-5f8a654d6544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '321715ec-8c3d-46ac-a0df-2c70c8b0de92', 'volume_name': 'volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c582c61-a248-4259-8a3d-514329dbef85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c582c61-a248-4259-8a3d-514329dbef85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b45881f-b6cc-4653-af60-e2f20ff0db99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:44 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Volume 321715ec-8c3d-46ac-a0df-2c70c8b0de92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92', 'volume_size': 1} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1449785490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321715ec-8c3d-46ac-a0df-2c70c8b0de92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b0c708591b44d69a2eb570ec3facb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:45Z,use_quota=True,user_id='9e09cf9cb777417fa2c7a89ae948d558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Creating volume 321715ec-8c3d-46ac-a0df-2c70c8b0de92 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:45:44 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:45:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:44 devstack sudo[114723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 1073741824 Jun 28 14:45:44 devstack sudo[114723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:45 devstack sudo[114708]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f 1G" returned: 0 in 0.876s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdf80a5-5180-4d33-934d-9eb2f0d8aa88]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:45 devstack sudo[114725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f Jun 28 14:45:45 devstack sudo[114725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:45 devstack sudo[114712]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD" returned: 1 in 0.881s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] 44535694-0019-4a62-bf13-39f44dd224ea was raw, converting to raw {{(pid=93561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:45 devstack sudo[114731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 Jun 28 14:45:45 devstack sudo[114731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:45 devstack sudo[114718]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3" returned: 0 in 0.719s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-quobyte-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3" released by "delete_volume" :: held 1.698s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Created reservations ['c24aa03f-1960-4cfa-9891-9fc927f977a3', '8696b979-36b0-4290-bbd4-8c3cbcb58329', 'd42beb3b-b366-45fd-80a9-254633c92b7a', '10d5b846-6315-4f6e-b9a4-e833bf28374d'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:45 devstack sudo[114733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:45:45 devstack sudo[114733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:45 devstack sudo[114723]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 1073741824" returned: 0 in 0.928s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "cinder-6004e6cd-c779-4789-9e09-bd20cddae019-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:45 devstack sudo[114743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 Jun 28 14:45:45 devstack sudo[114743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:45 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-6004e6cd-c779-4789-9e09-bd20cddae019-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "cinder-quobyte-6004e6cd-c779-4789-9e09-bd20cddae019" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-quobyte-6004e6cd-c779-4789-9e09-bd20cddae019" acquired by "delete_volume" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[382f9094-5909-4fa5-b6d2-a0dfe588b605]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6004e6cd-c779-4789-9e09-bd20cddae019 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:46 devstack sudo[114725]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f" returned: 0 in 1.026s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:46 devstack sudo[114731]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91" returned: 0 in 0.943s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_44535694-0019-4a62-bf13-39f44dd224ea_u3c258zydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:45:46 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Converted 0.00 MB image at 0.00 MB/s Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:46 devstack sudo[114748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 1G Jun 28 14:45:46 devstack sudo[114748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:46 devstack sudo[114746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6004e6cd-c779-4789-9e09-bd20cddae019 Jun 28 14:45:46 devstack sudo[114746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:46 devstack sudo[114747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f Jun 28 14:45:46 devstack sudo[114747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:46 devstack sudo[114733]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.894s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:45:46 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Deleted volume successfully. Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-53ab7fdb-617d-49d6-9b7d-199a303650c5 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-2cc80819-0ed2-47d6-bc47-9b8dbcdda2e3-delete_volume" released by "delete_volume" :: held 2.839s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:46 devstack sudo[114743]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92" returned: 0 in 0.802s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b45881f-b6cc-4653-af60-e2f20ff0db99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31af67a2-6c5f-4c3d-8987-cc4c0aecb0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:46 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Volume volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 (321715ec-8c3d-46ac-a0df-2c70c8b0de92): created successfully Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31af67a2-6c5f-4c3d-8987-cc4c0aecb0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:46 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Flow 'volume_create_manager' (5ce07745-a411-46aa-b92d-36cb5307d7e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:46 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f88d1fe7-4b3e-4aeb-adb1-bd29aad37b68 tempest-VolumeDependencyTests-793230099 None] Created volume successfully. Jun 28 14:45:47 devstack sudo[114747]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f" returned: 1 in 0.918s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Downloaded image 978504b9-5a87-423f-a624-c652de346de6 ((None, [{'url': 'file:///opt/stack/data/glance/images/978504b9-5a87-423f-a624-c652de346de6', 'metadata': {}}])) to volume 68dcae3a-0f88-4e5a-94ad-b63cc979dd6f successfully. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Temporary image 978504b9-5a87-423f-a624-c652de346de6 for user 1d0c368536bb40b88d59b7dd0b6c9f11 is deleted. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Marking volume 68dcae3a-0f88-4e5a-94ad-b63cc979dd6f as bootable. {{(pid=93561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Copying metadata from image 978504b9-5a87-423f-a624-c652de346de6 to 68dcae3a-0f88-4e5a-94ad-b63cc979dd6f. {{(pid=93561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Creating volume glance metadata for volume 68dcae3a-0f88-4e5a-94ad-b63cc979dd6f backed by image 978504b9-5a87-423f-a624-c652de346de6 with: {'image_id': '978504b9-5a87-423f-a624-c652de346de6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9880528bf0838478458fd96ba5b6cc0f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 28 14:45:47 devstack sudo[114748]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 1G" returned: 0 in 0.898s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba85565-9212-475a-b90c-4edae1e15429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f', 'volume_size': 1, 'image_id': '978504b9-5a87-423f-a624-c652de346de6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/978504b9-5a87-423f-a624-c652de346de6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9880528bf0838478458fd96ba5b6cc0f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4043576de590475699bd5dbcae682952', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '06602b92e9c589ae45683183470ed5ef49bf3b5c84ef02f0dee993662a5666b655815b0978213b1a425be33edef82a1dc41feef24f46e34046ed723d67d7ea79', 'id': '978504b9-5a87-423f-a624-c652de346de6', 'created_at': datetime.datetime(2026, 6, 28, 12, 45, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 45, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/978504b9-5a87-423f-a624-c652de346de6/file', 'properties': {}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:47 devstack sudo[114746]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7e3981-70a4-4ae5-86d1-05ac002ac3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b959bf2c-709a-42ef-99c7-c69495113d1c]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6004e6cd-c779-4789-9e09-bd20cddae019" returned: 0 in 1.097s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6004e6cd-c779-4789-9e09-bd20cddae019 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:47 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Volume volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f (68dcae3a-0f88-4e5a-94ad-b63cc979dd6f): created successfully Jun 28 14:45:47 devstack sudo[114798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6004e6cd-c779-4789-9e09-bd20cddae019 Jun 28 14:45:47 devstack sudo[114798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7e3981-70a4-4ae5-86d1-05ac002ac3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Flow 'volume_create_manager' (d9417106-c122-47a7-baa4-3ec2d5a446e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:47 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-939a2355-8f92-47a9-b45a-28a06b550afa tempest-VolumeImageDependencyTests-1515651679 None] Created volume successfully. Jun 28 14:45:47 devstack sudo[114797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 Jun 28 14:45:47 devstack sudo[114797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:47 devstack sudo[114798]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-6004e6cd-c779-4789-9e09-bd20cddae019" returned: 0 in 0.677s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-quobyte-6004e6cd-c779-4789-9e09-bd20cddae019" released by "delete_volume" :: held 1.831s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Created reservations ['ed498bb1-a159-4190-a4b5-f7f244f2765b', 'c744cf6d-8442-452c-af27-a3998b6a1b91', '30086a56-08eb-43b0-8313-c6c60f688bf8', 'cae91eb3-d285-48e0-9fef-783268f93128'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:45:47 devstack sudo[114797]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91" returned: 0 in 0.811s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:48 devstack sudo[114807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:45:48 devstack sudo[114807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:48 devstack sudo[114806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 Jun 28 14:45:48 devstack sudo[114806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "cinder-a1b5a332-b869-4a4c-818e-6e55e6bc0e50-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] Creating offline snapshot 499d5355-14db-487b-b181-81647c8332c9 of volume 321715ec-8c3d-46ac-a0df-2c70c8b0de92 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-a1b5a332-b869-4a4c-818e-6e55e6bc0e50-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f9ab7b-c847-4db7-b56f-ad7a275a693f]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "cinder-quobyte-a1b5a332-b869-4a4c-818e-6e55e6bc0e50" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-quobyte-a1b5a332-b869-4a4c-818e-6e55e6bc0e50" acquired by "delete_volume" :: waited 0.035s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7accdef-1b8e-4897-a451-f9c8e834166c]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:48 devstack sudo[114810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 Jun 28 14:45:48 devstack sudo[114810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Acquiring lock "cinder-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Lock "cinder-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Acquiring lock "cinder-quobyte-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Lock "cinder-quobyte-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f" acquired by "delete_volume" :: waited 0.025s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5247a1b-cb1c-445f-b8de-ea4b68d0a1ab]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:48 devstack sudo[114812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50 Jun 28 14:45:48 devstack sudo[114812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:48 devstack sudo[114813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f Jun 28 14:45:48 devstack sudo[114813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:48 devstack sudo[114806]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91" returned: 1 in 1.035s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Downloaded image 44535694-0019-4a62-bf13-39f44dd224ea ((None, [{'url': 'file:///opt/stack/data/glance/images/44535694-0019-4a62-bf13-39f44dd224ea', 'metadata': {}}])) to volume ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 successfully. {{(pid=93561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Temporary image 44535694-0019-4a62-bf13-39f44dd224ea for user 023c502b77c84b488b1f3b39fdd57815 is deleted. {{(pid=93561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 28 14:45:48 devstack cinder-volume[93561]: DEBUG cinder.volume.volume_utils [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Marking volume ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 as bootable. {{(pid=93561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Copying metadata from image 44535694-0019-4a62-bf13-39f44dd224ea to ab14b87a-d936-4e1c-b89f-cd2fb5a16a91. {{(pid=93561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Creating volume glance metadata for volume ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 backed by image 44535694-0019-4a62-bf13-39f44dd224ea with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '44535694-0019-4a62-bf13-39f44dd224ea', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1333b8fc1cec370736b7f7611b892aab', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4fdb6e-3a67-46a7-95b6-2e57fc37fe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91', 'volume_size': 1, 'image_id': '44535694-0019-4a62-bf13-39f44dd224ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44535694-0019-4a62-bf13-39f44dd224ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1333b8fc1cec370736b7f7611b892aab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '68c760418db84b73aae997ef71320621', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb07e9865b7e40e55fa5683822b05cff57be4dfe38f5df6cd349a3022b8a0fb514d92ee79977ebcff1f1c124fd6ced2f951ebf9e1076c6a03925b65543ffd0a3', 'id': '44535694-0019-4a62-bf13-39f44dd224ea', 'created_at': datetime.datetime(2026, 6, 28, 12, 45, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 28, 12, 45, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44535694-0019-4a62-bf13-39f44dd224ea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8a116d-4be9-494c-a431-6bb61506f69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:49 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Volume volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 (ab14b87a-d936-4e1c-b89f-cd2fb5a16a91): created successfully Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8a116d-4be9-494c-a431-6bb61506f69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Flow 'volume_create_manager' (3b28fe47-a7f3-44be-b3a0-1ee279e439e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:49 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-b8f2387c-d0dd-433b-b1b8-54376cbb472c tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Created volume successfully. Jun 28 14:45:49 devstack sudo[114807]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.240s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:45:49 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Deleted volume successfully. Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5f0d8bbb-80ef-437c-a121-3d6b212218f6 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-6004e6cd-c779-4789-9e09-bd20cddae019-delete_volume" released by "delete_volume" :: held 3.340s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:49 devstack sudo[114810]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92" returned: 0 in 1.040s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:49 devstack sudo[114823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 1G Jun 28 14:45:49 devstack sudo[114823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Acquiring lock "cinder-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Lock "cinder-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Acquiring lock "cinder-quobyte-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Lock "cinder-quobyte-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91" acquired by "delete_volume" :: waited 0.020s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7a4d99-7534-4c87-8195-77be5d67e835]: (4, 'raw') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:49 devstack sudo[114813]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f" returned: 0 in 0.966s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:49 devstack sudo[114812]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50" returned: 0 in 1.191s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:49 devstack sudo[114832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50 Jun 28 14:45:49 devstack sudo[114832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:49 devstack sudo[114830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 Jun 28 14:45:49 devstack sudo[114830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:49 devstack sudo[114831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f Jun 28 14:45:49 devstack sudo[114831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:50 devstack sudo[114823]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 1G" returned: 0 in 0.928s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:50 devstack sudo[114844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 Jun 28 14:45:50 devstack sudo[114844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:50 devstack sudo[114832]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a1b5a332-b869-4a4c-818e-6e55e6bc0e50" returned: 0 in 0.681s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-quobyte-a1b5a332-b869-4a4c-818e-6e55e6bc0e50" released by "delete_volume" :: held 1.932s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Created reservations ['dc5af6b5-bd91-42bc-b2af-e0c7169f3f26', 'c54dd231-99ad-4e6a-a3a4-44dcf813daaa', '10e5246a-846a-4aec-bbb9-56688336929f', '35c7f941-947f-43ab-a582-1a7f8cc78e94'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:45:50 devstack sudo[114830]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91" returned: 0 in 0.861s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:50 devstack sudo[114831]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f" returned: 1 in 0.886s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:45:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:50 devstack sudo[114851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:45:50 devstack sudo[114851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:50 devstack sudo[114852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f Jun 28 14:45:50 devstack sudo[114852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:50 devstack sudo[114850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 Jun 28 14:45:50 devstack sudo[114850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:51 devstack sudo[114844]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9" returned: 0 in 0.800s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:51 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 is being set with open permissions: ugo+rw Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:51 devstack sudo[114860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 Jun 28 14:45:51 devstack sudo[114860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:51 devstack sudo[114851]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.733s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:45:51 devstack sudo[114852]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:51 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Deleted volume successfully. Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f" returned: 0 in 0.728s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:51 devstack sudo[114850]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Lock "cinder-quobyte-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f" released by "delete_volume" :: held 2.705s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91" returned: 1 in 0.847s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91' failed. Not Retrying. {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:51 devstack sudo[114867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91 Jun 28 14:45:51 devstack sudo[114867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-2657f487-2db0-45fe-9525-5b73c5289719 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-a1b5a332-b869-4a4c-818e-6e55e6bc0e50-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Created reservations ['ea3f3b96-9045-4d62-bef8-67ae22d94b9b', 'd1c97a44-2517-4742-8e78-7359ab001189', 'be40a499-c584-4a34-a5fe-69e1a5b2b024', '76c6ef2f-303b-45ac-921d-b30e4b613b50'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:51 devstack sudo[114869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:45:51 devstack sudo[114869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "cinder-5b28aaac-c11b-4deb-bd15-fddc847ab1af-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-5b28aaac-c11b-4deb-bd15-fddc847ab1af-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "cinder-quobyte-5b28aaac-c11b-4deb-bd15-fddc847ab1af" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-quobyte-5b28aaac-c11b-4deb-bd15-fddc847ab1af" acquired by "delete_volume" :: waited 0.028s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[406a7735-27cf-40ec-9479-89ded5424449]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:51 devstack sudo[114860]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9" returned: 0 in 0.718s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:51 devstack sudo[114873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.info Jun 28 14:45:51 devstack sudo[114873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:51 devstack sudo[114872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af Jun 28 14:45:51 devstack sudo[114872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:52 devstack sudo[114867]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91" returned: 0 in 0.798s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Lock "cinder-quobyte-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91" released by "delete_volume" :: held 2.576s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Created reservations ['0cbc1555-4dce-4b43-bcf2-24b21b01c6db', '32c0373f-5244-42bb-a535-149157ad878f', 'c9a1cc4d-c03a-4a91-8e86-607644179f3b', 'a33e7cde-7fb9-4300-8d30-11ebe8160e87'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:52 devstack sudo[114878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:45:52 devstack sudo[114878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:52 devstack sudo[114869]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.962s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:45:52 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Deleted volume successfully. Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-07fed361-5147-47be-b50e-b355f0c8c5c3 tempest-VolumeImageDependencyTests-1515651679 None] Lock "cinder-68dcae3a-0f88-4e5a-94ad-b63cc979dd6f-delete_volume" released by "delete_volume" :: held 3.922s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:52 devstack sudo[114873]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.info" returned: 0 in 0.808s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:52 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.info is being set with open permissions: ugo+rw Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:52 devstack sudo[114882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.info Jun 28 14:45:52 devstack sudo[114882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:52 devstack sudo[114872]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af" returned: 0 in 1.132s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:52 devstack sudo[114887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af Jun 28 14:45:52 devstack sudo[114887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:53 devstack sudo[114878]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.858s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:53 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:45:53 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Deleted volume successfully. Jun 28 14:45:53 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-e4544989-cfec-491d-a0f6-acad672fe5df tempest-VolumeAndVolumeTypeFromImageTest-1289401028 None] Lock "cinder-ab14b87a-d936-4e1c-b89f-cd2fb5a16a91-delete_volume" released by "delete_volume" :: held 3.728s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:53 devstack sudo[114882]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.info" returned: 0 in 0.845s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.316s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:53 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-d4d54492-feb8-48ff-b594-86f57d23f05f tempest-VolumeDependencyTests-793230099 None] Create snapshot completed successfully Jun 28 14:45:53 devstack sudo[114887]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-5b28aaac-c11b-4deb-bd15-fddc847ab1af" returned: 0 in 0.852s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:53 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-quobyte-5b28aaac-c11b-4deb-bd15-fddc847ab1af" released by "delete_volume" :: held 2.041s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:53 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Created reservations ['841e1038-5dce-4ada-9fdc-145ba5d11670', '392456df-469a-4511-aeb3-be29f1fc1773', '8fc52f54-ca95-49a9-be82-30499d529077', 'ab0f1e67-caa3-4db0-b307-f02744c88c5c'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:45:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:53 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:53 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:53 devstack sudo[114892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:45:53 devstack sudo[114892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.707s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:54 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:45:54 devstack sudo[114892]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:54 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Deleted volume successfully. Jun 28 14:45:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3675b733-21cc-4a23-a4ed-66e1b675b751 tempest-CreateVolumesFromSourceVolumeTest-1797197113 None] Lock "cinder-5b28aaac-c11b-4deb-bd15-fddc847ab1af-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Flow 'volume_create_manager' (b2e7f110-0076-487a-a732-ae2e3211981c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5db9e75-baca-49f2-aac6-53a7a02eb185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5db9e75-baca-49f2-aac6-53a7a02eb185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-616988546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2646562-5105-4558-b16d-37e8bfc1a6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b0c708591b44d69a2eb570ec3facb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=499d5355-14db-487b-b181-81647c8332c9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:55Z,use_quota=True,user_id='9e09cf9cb777417fa2c7a89ae948d558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f24c442-d7d4-4185-879f-e69e0b1cb34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f24c442-d7d4-4185-879f-e69e0b1cb34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ad2513-51cb-43be-a176-9e80ac9395fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ad2513-51cb-43be-a176-9e80ac9395fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a2646562-5105-4558-b16d-37e8bfc1a6f7', 'volume_name': 'volume-a2646562-5105-4558-b16d-37e8bfc1a6f7', 'volume_size': 1, 'snapshot_id': '499d5355-14db-487b-b181-81647c8332c9'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c541efe-86fa-4303-a691-24d4bedc6e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c541efe-86fa-4303-a691-24d4bedc6e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10624268-467f-4844-94fd-1a6ba7696784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:55 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Volume a2646562-5105-4558-b16d-37e8bfc1a6f7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a2646562-5105-4558-b16d-37e8bfc1a6f7', 'volume_size': 1, 'snapshot_id': '499d5355-14db-487b-b181-81647c8332c9'} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Acquiring lock "cinder-quobyte-499d5355-14db-487b-b181-81647c8332c9-a2646562-5105-4558-b16d-37e8bfc1a6f7" by "_create_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Lock "cinder-quobyte-499d5355-14db-487b-b181-81647c8332c9-a2646562-5105-4558-b16d-37e8bfc1a6f7" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Creating volume a2646562-5105-4558-b16d-37e8bfc1a6f7 from snapshot 499d5355-14db-487b-b181-81647c8332c9 {{(pid=93561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Acquiring lock "cinder-quobyte-a2646562-5105-4558-b16d-37e8bfc1a6f7" by "_copy_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Lock "cinder-quobyte-a2646562-5105-4558-b16d-37e8bfc1a6f7" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] snapshot: 499d5355-14db-487b-b181-81647c8332c9, volume: a2646562-5105-4558-b16d-37e8bfc1a6f7, {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[07da4aef-6b7c-4667-9379-d0f5724ce42e]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:55 devstack sudo[114895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 Jun 28 14:45:55 devstack sudo[114895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Flow 'volume_create_manager' (dfb18b7d-c83b-4d44-ad6c-262b971be14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb9b2b3-88d5-45f5-8d0d-8b128b452fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb9b2b3-88d5-45f5-8d0d-8b128b452fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85f4531-f8c9-47f1-b16e-94781b840521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0730bc1e0734ec7b93d0766f1d11617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:56Z,use_quota=True,user_id='b5ba01c9ac09419ba821ede2936706c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dad064d-8f14-4f1a-a71d-706412c0027a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dad064d-8f14-4f1a-a71d-706412c0027a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54103b26-a657-4a13-9ff2-81cbaae837d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:56 devstack sudo[114895]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54103b26-a657-4a13-9ff2-81cbaae837d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e85f4531-f8c9-47f1-b16e-94781b840521', 'volume_name': 'volume-e85f4531-f8c9-47f1-b16e-94781b840521', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba20665-9208-4c0c-8238-59e9929daaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba20665-9208-4c0c-8238-59e9929daaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490e9dd5-2631-4b33-9beb-50a0b17459e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:56 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Volume e85f4531-f8c9-47f1-b16e-94781b840521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e85f4531-f8c9-47f1-b16e-94781b840521', 'volume_size': 1} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9" returned: 0 in 1.063s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Creating direct copy from snapshot {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0664453f-f3ee-46b0-b9b5-e9302392d5d2]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:45:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:56 devstack sudo[114901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 Jun 28 14:45:56 devstack sudo[114901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:57 devstack sudo[114901]: pam_unix(sudo:session): session closed for user root Jun 28 14:45:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92" returned: 0 in 0.879s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:45:57 devstack cinder-volume[93561]: DEBUG cinder.utils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Path /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2646562-5105-4558-b16d-37e8bfc1a6f7 not found in is_blk_device check {{(pid=93561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 28 14:45:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2646562-5105-4558-b16d-37e8bfc1a6f7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:45:57 devstack sudo[114907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2646562-5105-4558-b16d-37e8bfc1a6f7 Jun 28 14:45:57 devstack sudo[114907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:45:58 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:45:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Flow 'volume_create_manager' (cea8cf7d-cbda-4981-b50e-7436bdb7eebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:45:58 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d685873-9cc0-4cea-a3d8-f8e3230765ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d685873-9cc0-4cea-a3d8-f8e3230765ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-4138201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e911ac-23f0-46ad-bee8-6e861f724e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0d7e8117cf4f1a8f5ea07a7ca4df94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:59Z,use_quota=True,user_id='4f4599e2206a412595f00c270561bbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af136f78-2c23-4d76-a845-45c85a5f80db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af136f78-2c23-4d76-a845-45c85a5f80db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e777e55-e1b1-4e0c-8d00-214f03fd3c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e777e55-e1b1-4e0c-8d00-214f03fd3c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e911ac-23f0-46ad-bee8-6e861f724e6b', 'volume_name': 'volume-65e911ac-23f0-46ad-bee8-6e861f724e6b', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed130f8f-d9be-4163-85bb-9c70a09112a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed130f8f-d9be-4163-85bb-9c70a09112a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:45:59 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3645a6-21c0-48ec-8b04-3160b43680dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:45:59 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume 65e911ac-23f0-46ad-bee8-6e861f724e6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e911ac-23f0-46ad-bee8-6e861f724e6b', 'volume_size': 1} Jun 28 14:45:59 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:03 devstack sudo[114907]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2646562-5105-4558-b16d-37e8bfc1a6f7" returned: 0 in 5.581s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:03 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea29c0c-ff0a-4e11-9d92-04f889df8f91]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:03 devstack sudo[114921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 Jun 28 14:46:03 devstack sudo[114921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:03 devstack sudo[114921]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92" returned: 0 in 0.943s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:03 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Image conversion details: src /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2646562-5105-4558-b16d-37e8bfc1a6f7 {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:46:03 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Converted 1024.00 MB image at 183.43 MB/s Jun 28 14:46:03 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2646562-5105-4558-b16d-37e8bfc1a6f7 is being set with open permissions: ugo+rw Jun 28 14:46:03 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2646562-5105-4558-b16d-37e8bfc1a6f7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:04 devstack sudo[114926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2646562-5105-4558-b16d-37e8bfc1a6f7 Jun 28 14:46:04 devstack sudo[114926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:04 devstack sudo[114926]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2646562-5105-4558-b16d-37e8bfc1a6f7" returned: 0 in 0.694s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Lock "cinder-quobyte-a2646562-5105-4558-b16d-37e8bfc1a6f7" released by "_copy_volume_from_snapshot" :: held 9.275s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Lock "cinder-quobyte-499d5355-14db-487b-b181-81647c8332c9-a2646562-5105-4558-b16d-37e8bfc1a6f7" released by "_create_volume_from_snapshot" :: held 9.316s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.342s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.165s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85f4531-f8c9-47f1-b16e-94781b840521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0730bc1e0734ec7b93d0766f1d11617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:56Z,use_quota=True,user_id='b5ba01c9ac09419ba821ede2936706c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Creating volume e85f4531-f8c9-47f1-b16e-94781b840521 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:46:04 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e85f4531-f8c9-47f1-b16e-94781b840521 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:04 devstack sudo[114929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e85f4531-f8c9-47f1-b16e-94781b840521 1073741824 Jun 28 14:46:04 devstack sudo[114929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10624268-467f-4844-94fd-1a6ba7696784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2646562-5105-4558-b16d-37e8bfc1a6f7', 'volume_size': 1, 'snapshot_id': '499d5355-14db-487b-b181-81647c8332c9'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efbc97d-cf1d-4aef-b99d-50b10b18e1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:04 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Volume volume-a2646562-5105-4558-b16d-37e8bfc1a6f7 (a2646562-5105-4558-b16d-37e8bfc1a6f7): created successfully Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efbc97d-cf1d-4aef-b99d-50b10b18e1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:04 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Flow 'volume_create_manager' (b2e7f110-0076-487a-a732-ae2e3211981c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:04 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a870cb4b-c7ae-4f35-b8fa-73d32d8cfe83 tempest-VolumeDependencyTests-793230099 None] Created volume successfully. Jun 28 14:46:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Acquiring lock "cinder-499d5355-14db-487b-b181-81647c8332c9-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Lock "cinder-499d5355-14db-487b-b181-81647c8332c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Acquiring lock "cinder-quobyte-321715ec-8c3d-46ac-a0df-2c70c8b0de92" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Lock "cinder-quobyte-321715ec-8c3d-46ac-a0df-2c70c8b0de92" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Acquiring lock "cinder-quobyte-499d5355-14db-487b-b181-81647c8332c9" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:05 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Lock "cinder-quobyte-499d5355-14db-487b-b181-81647c8332c9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Deleting offline snapshot 499d5355-14db-487b-b181-81647c8332c9 of volume 321715ec-8c3d-46ac-a0df-2c70c8b0de92 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:46:05 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] snapshot_file for this snap is: volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:46:05 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fb9712-a2ef-4458-b2a2-77d78ec41d22]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:05 devstack sudo[114934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 Jun 28 14:46:05 devstack sudo[114934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:05 devstack sudo[114929]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e85f4531-f8c9-47f1-b16e-94781b840521 1073741824" returned: 0 in 1.042s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:05 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e85f4531-f8c9-47f1-b16e-94781b840521 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:05 devstack sudo[114937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e85f4531-f8c9-47f1-b16e-94781b840521 Jun 28 14:46:05 devstack sudo[114937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:06 devstack sudo[114934]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9" returned: 0 in 1.020s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46d65dc-da30-4722-b758-2cc778e24142]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:06 devstack sudo[114942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 Jun 28 14:46:06 devstack sudo[114942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:06 devstack sudo[114937]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e85f4531-f8c9-47f1-b16e-94781b840521" returned: 0 in 0.748s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.330s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-4138201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e911ac-23f0-46ad-bee8-6e861f724e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0d7e8117cf4f1a8f5ea07a7ca4df94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:45:59Z,use_quota=True,user_id='4f4599e2206a412595f00c270561bbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Creating volume 65e911ac-23f0-46ad-bee8-6e861f724e6b {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:46:06 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:06 devstack sudo[114945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b 1073741824 Jun 28 14:46:06 devstack sudo[114945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490e9dd5-2631-4b33-9beb-50a0b17459e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e85f4531-f8c9-47f1-b16e-94781b840521', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4c389e-d617-483f-b406-5c89cd0a2954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:06 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Volume volume-e85f4531-f8c9-47f1-b16e-94781b840521 (e85f4531-f8c9-47f1-b16e-94781b840521): created successfully Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4c389e-d617-483f-b406-5c89cd0a2954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:06 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Flow 'volume_create_manager' (dfb18b7d-c83b-4d44-ad6c-262b971be14d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:06 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-026cda46-a9e9-43c3-9b41-8344a932462b tempest-CinderUnicodeTest-360568386 None] Created volume successfully. Jun 28 14:46:07 devstack sudo[114942]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92" returned: 0 in 0.924s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:07 devstack sudo[114953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 Jun 28 14:46:07 devstack sudo[114953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:07 devstack sudo[114945]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b 1073741824" returned: 0 in 1.052s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:07 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:07 devstack sudo[114956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b Jun 28 14:46:07 devstack sudo[114956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Flow 'volume_create_manager' (d9a95ccf-da06-488d-8c46-6bcb507c41eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5600510f-3163-4cd4-ae1c-3c7ea4029d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5600510f-3163-4cd4-ae1c-3c7ea4029d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:46:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-64795971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8611182d-adfb-41af-b2d2-211f2a8adc27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0730bc1e0734ec7b93d0766f1d11617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:46:08Z,use_quota=True,user_id='b5ba01c9ac09419ba821ede2936706c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480b136d-ed40-4682-bd1c-8061d0c42c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480b136d-ed40-4682-bd1c-8061d0c42c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ecbaa2-4c37-45d5-83a6-95339b576659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ecbaa2-4c37-45d5-83a6-95339b576659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8611182d-adfb-41af-b2d2-211f2a8adc27', 'volume_name': 'volume-8611182d-adfb-41af-b2d2-211f2a8adc27', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be569b8e-b1e0-4913-ae64-128ce70dc918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be569b8e-b1e0-4913-ae64-128ce70dc918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3a23e5-e27a-4176-8a23-23c6ead20b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:08 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Volume 8611182d-adfb-41af-b2d2-211f2a8adc27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8611182d-adfb-41af-b2d2-211f2a8adc27', 'volume_size': 1} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:08 devstack sudo[114953]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9" returned: 0 in 1.026s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:08 devstack sudo[114961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9 Jun 28 14:46:08 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:08 devstack sudo[114956]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b" returned: 0 in 1.015s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:46:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-64795971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8611182d-adfb-41af-b2d2-211f2a8adc27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0730bc1e0734ec7b93d0766f1d11617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:46:08Z,use_quota=True,user_id='b5ba01c9ac09419ba821ede2936706c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Creating volume 8611182d-adfb-41af-b2d2-211f2a8adc27 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:46:08 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3645a6-21c0-48ec-8b04-3160b43680dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e911ac-23f0-46ad-bee8-6e861f724e6b', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:08 devstack sudo[114964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27 1073741824 Jun 28 14:46:08 devstack sudo[114964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3c4d10-8e13-4c83-bccc-0914af7bd9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=123,cinder:UPDATE=157,cinder:INSERT=39,cinder:DELETE=15 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:46:08 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume volume-65e911ac-23f0-46ad-bee8-6e861f724e6b (65e911ac-23f0-46ad-bee8-6e861f724e6b): created successfully Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3c4d10-8e13-4c83-bccc-0914af7bd9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:08 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Flow 'volume_create_manager' (cea8cf7d-cbda-4981-b50e-7436bdb7eebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:08 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-c502d137-e7b4-4925-bca7-9fb913596d52 tempest-CreateVolumesFromSnapshotTest-122782935 None] Created volume successfully. Jun 28 14:46:09 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92.499d5355-14db-487b-b181-81647c8332c9" returned: 0 in 0.781s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:09 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=110,cinder:UPDATE=162,cinder:INSERT=49,cinder:DELETE=16 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:46:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Lock "cinder-quobyte-499d5355-14db-487b-b181-81647c8332c9" released by "_delete_snapshot" :: held 3.902s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Lock "cinder-quobyte-321715ec-8c3d-46ac-a0df-2c70c8b0de92" released by "delete_snapshot" :: held 3.939s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:09 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Created reservations ['8126e29a-2018-4777-bafc-d712b96921ce', 'b63c6ff2-7e09-48b6-a969-3deabbce34e2', '9029f3a9-968f-44cd-83ec-65cdfdbd671f', 'ddadc178-faf3-4fb9-9571-abf694af5312'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:09 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Delete snapshot completed successfully. Jun 28 14:46:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-977a04ae-1d55-4509-abf5-ffba65ee7569 tempest-VolumeDependencyTests-793230099 None] Lock "cinder-499d5355-14db-487b-b181-81647c8332c9-delete_snapshot" released by "delete_snapshot" :: held 4.125s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Acquiring lock "cinder-321715ec-8c3d-46ac-a0df-2c70c8b0de92-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Lock "cinder-321715ec-8c3d-46ac-a0df-2c70c8b0de92-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Acquiring lock "cinder-quobyte-321715ec-8c3d-46ac-a0df-2c70c8b0de92" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:09 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Lock "cinder-quobyte-321715ec-8c3d-46ac-a0df-2c70c8b0de92" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:09 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a91993-bf3a-48f3-87ec-5ddf74336b41]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:09 devstack sudo[114964]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27 1073741824" returned: 0 in 1.043s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:09 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:09 devstack sudo[114972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27 Jun 28 14:46:09 devstack sudo[114972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:09 devstack sudo[114971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 Jun 28 14:46:09 devstack sudo[114971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:10 devstack sudo[114972]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27" returned: 0 in 0.791s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:10 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:46:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.525s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:10 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] Creating offline snapshot c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f of volume 65e911ac-23f0-46ad-bee8-6e861f724e6b {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:46:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3a23e5-e27a-4176-8a23-23c6ead20b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8611182d-adfb-41af-b2d2-211f2a8adc27', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0924f697-db23-430d-b033-c622cc481c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:10 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffb0139-3b5a-4dd5-884f-2f6a13f11a98]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:10 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Volume volume-8611182d-adfb-41af-b2d2-211f2a8adc27 (8611182d-adfb-41af-b2d2-211f2a8adc27): created successfully Jun 28 14:46:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0924f697-db23-430d-b033-c622cc481c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:10 devstack sudo[114971]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:10 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Flow 'volume_create_manager' (d9a95ccf-da06-488d-8c46-6bcb507c41eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92" returned: 0 in 1.016s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:10 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:10 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-0aefe4bb-19ba-41f2-88bc-221569bc13e7 tempest-CinderUnicodeTest-360568386 None] Created volume successfully. Jun 28 14:46:10 devstack sudo[114982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92 Jun 28 14:46:10 devstack sudo[114982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:10 devstack sudo[114981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b Jun 28 14:46:10 devstack sudo[114981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:11 devstack sudo[114982]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-321715ec-8c3d-46ac-a0df-2c70c8b0de92" returned: 0 in 0.937s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Lock "cinder-quobyte-321715ec-8c3d-46ac-a0df-2c70c8b0de92" released by "delete_volume" :: held 2.043s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:11 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Created reservations ['1203c7a1-b99e-4c07-856f-b9fb95a66561', '59e9e5a4-7baa-48a0-8816-68da5cc735c7', 'f07fc3a8-e0d5-40d7-8aaa-d3aa48abc420', '523506e7-6243-409a-bc36-520a1fee3dc2'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:11 devstack sudo[114981]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b" returned: 0 in 1.100s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:11 devstack sudo[114989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f 1G Jun 28 14:46:11 devstack sudo[114989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:11 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:11 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:11 devstack sudo[114991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:46:11 devstack sudo[114991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Acquiring lock "cinder-a2646562-5105-4558-b16d-37e8bfc1a6f7-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Lock "cinder-a2646562-5105-4558-b16d-37e8bfc1a6f7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:11 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Acquiring lock "cinder-quobyte-a2646562-5105-4558-b16d-37e8bfc1a6f7" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Lock "cinder-quobyte-a2646562-5105-4558-b16d-37e8bfc1a6f7" acquired by "delete_volume" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:12 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7ffebc-128e-4473-80c5-7c7259956c2d]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2646562-5105-4558-b16d-37e8bfc1a6f7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:12 devstack sudo[114993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2646562-5105-4558-b16d-37e8bfc1a6f7 Jun 28 14:46:12 devstack sudo[114993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:12 devstack sudo[114991]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.837s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:12 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:46:12 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Deleted volume successfully. Jun 28 14:46:12 devstack sudo[114989]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f 1G" returned: 0 in 0.970s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65e911ac-23f0-46ad-bee8-6e861f724e6b -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:12 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-b6603579-349d-4ad5-b73b-e7f14625437e tempest-VolumeDependencyTests-793230099 None] Lock "cinder-321715ec-8c3d-46ac-a0df-2c70c8b0de92-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:12 devstack sudo[115000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65e911ac-23f0-46ad-bee8-6e861f724e6b -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f Jun 28 14:46:12 devstack sudo[115000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:12 devstack sudo[114993]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2646562-5105-4558-b16d-37e8bfc1a6f7" returned: 0 in 0.936s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:12 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2646562-5105-4558-b16d-37e8bfc1a6f7 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:13 devstack sudo[115006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2646562-5105-4558-b16d-37e8bfc1a6f7 Jun 28 14:46:13 devstack sudo[115006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:13 devstack sudo[115000]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65e911ac-23f0-46ad-bee8-6e861f724e6b -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f" returned: 0 in 0.844s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:13 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f is being set with open permissions: ugo+rw Jun 28 14:46:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:13 devstack sudo[115015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f Jun 28 14:46:13 devstack sudo[115015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:13 devstack sudo[115006]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-a2646562-5105-4558-b16d-37e8bfc1a6f7" returned: 0 in 0.772s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:13 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Lock "cinder-quobyte-a2646562-5105-4558-b16d-37e8bfc1a6f7" released by "delete_volume" :: held 1.757s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:13 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Created reservations ['98dfe658-0b8e-4bb5-b584-f6176167222d', '8cb7ff64-412e-45cb-b5c0-a065a84eb37b', '56e876aa-f944-4e77-8143-fae77f61f8ed', '7596b14b-8a38-474e-baf3-5362717cb3e5'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:13 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:13 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:13 devstack sudo[115018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:46:13 devstack sudo[115018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:14 devstack sudo[115015]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f" returned: 0 in 0.737s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:14 devstack sudo[115021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.info Jun 28 14:46:14 devstack sudo[115021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:14 devstack sudo[115018]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:14 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.774s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:14 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:46:14 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Deleted volume successfully. Jun 28 14:46:14 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-f87e0f1c-2546-4770-8903-644a82a68c44 tempest-VolumeDependencyTests-793230099 None] Lock "cinder-a2646562-5105-4558-b16d-37e8bfc1a6f7-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:15 devstack sudo[115021]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.info" returned: 0 in 0.779s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:15 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.info is being set with open permissions: ugo+rw Jun 28 14:46:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:15 devstack sudo[115025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.info Jun 28 14:46:15 devstack sudo[115025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:15 devstack sudo[115025]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.info" returned: 0 in 0.800s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.386s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:15 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.416s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:15 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] Creating offline snapshot 45fbfb56-fce7-42da-8a5a-c107318c4245 of volume 8611182d-adfb-41af-b2d2-211f2a8adc27 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:46:16 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-a30b6588-08b5-4f94-beaf-7058540897af tempest-CreateVolumesFromSnapshotTest-122782935 None] Create snapshot completed successfully Jun 28 14:46:16 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be1dd61-e93a-48a9-9fbd-538ffd3c1ed0]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:16 devstack sudo[115028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27 Jun 28 14:46:16 devstack sudo[115028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:16 devstack sudo[115028]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27" returned: 0 in 0.881s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:16 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:16 devstack sudo[115034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245 1G Jun 28 14:46:16 devstack sudo[115034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Flow 'volume_create_manager' (d6898710-88b1-4f8b-b049-e0044c943a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3f6a76-1557-4f20-9493-0cd463c868d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3f6a76-1557-4f20-9493-0cd463c868d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-966969039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bdf5207-e46c-4e0c-941f-56f9239bcfb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0d7e8117cf4f1a8f5ea07a7ca4df94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:46:17Z,use_quota=True,user_id='4f4599e2206a412595f00c270561bbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50da5e83-eca6-4617-8533-a742004bda0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50da5e83-eca6-4617-8533-a742004bda0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39fe55b5-bf18-4d58-9a4f-0ebc2d77817a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39fe55b5-bf18-4d58-9a4f-0ebc2d77817a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bdf5207-e46c-4e0c-941f-56f9239bcfb6', 'volume_name': 'volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e22e1c1-1672-4913-965f-a5068e33eb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e22e1c1-1672-4913-965f-a5068e33eb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31223cd-2fbf-411d-b96f-7fec2e75229b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:17 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume 7bdf5207-e46c-4e0c-941f-56f9239bcfb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6', 'volume_size': 1} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Flow 'volume_create_manager' (a3d2bb95-6245-49b7-b5a3-33c89b7cfd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a737591-6f1f-47a9-9260-43155058dfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a737591-6f1f-47a9-9260-43155058dfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1639046120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4680fd0-0fad-4b02-9e08-cd0249b98004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0d7e8117cf4f1a8f5ea07a7ca4df94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:46:17Z,use_quota=True,user_id='4f4599e2206a412595f00c270561bbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e0063b-3623-431a-b869-921aa0a4cb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e0063b-3623-431a-b869-921aa0a4cb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e9fff1-ed4e-48cb-99c3-2055af2a80b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e9fff1-ed4e-48cb-99c3-2055af2a80b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4680fd0-0fad-4b02-9e08-cd0249b98004', 'volume_name': 'volume-b4680fd0-0fad-4b02-9e08-cd0249b98004', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce868913-e800-47b3-bfeb-67ba7bda9c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce868913-e800-47b3-bfeb-67ba7bda9c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7517b04e-1fbf-44dd-8645-f674078f3922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:17 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume b4680fd0-0fad-4b02-9e08-cd0249b98004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4680fd0-0fad-4b02-9e08-cd0249b98004', 'volume_size': 1} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Flow 'volume_create_manager' (6e4bbb7e-71ae-4b97-b5a6-d9a37b4f69b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d886f57-30ce-49a9-b02f-dbd0bcf32499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d886f57-30ce-49a9-b02f-dbd0bcf32499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-585963413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad701c2-4268-41e5-b93f-a38205582a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0d7e8117cf4f1a8f5ea07a7ca4df94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:46:18Z,use_quota=True,user_id='4f4599e2206a412595f00c270561bbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f5a73c-9c65-497d-b6cd-809a99df4952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:17 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f5a73c-9c65-497d-b6cd-809a99df4952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f4842d-890e-49ed-abc3-2fad192ef476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f4842d-890e-49ed-abc3-2fad192ef476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cad701c2-4268-41e5-b93f-a38205582a78', 'volume_name': 'volume-cad701c2-4268-41e5-b93f-a38205582a78', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4928cb-a630-497b-8a14-1e6fd7c0bc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4928cb-a630-497b-8a14-1e6fd7c0bc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45278bb-784f-4ef5-8398-ad2a2e509f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:18 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume cad701c2-4268-41e5-b93f-a38205582a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cad701c2-4268-41e5-b93f-a38205582a78', 'volume_size': 1} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:18 devstack sudo[115034]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245 1G" returned: 0 in 1.361s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8611182d-adfb-41af-b2d2-211f2a8adc27 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:18 devstack sudo[115039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8611182d-adfb-41af-b2d2-211f2a8adc27 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245 Jun 28 14:46:18 devstack sudo[115039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Flow 'volume_create_manager' (99b8ffff-3cb6-4614-b979-5dc6a4c8da26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a87c921-53b2-422a-bb07-e237c125a779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a87c921-53b2-422a-bb07-e237c125a779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883175563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4659d1d6-19d7-4ef1-b0f6-6737b83e677d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0d7e8117cf4f1a8f5ea07a7ca4df94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:46:18Z,use_quota=True,user_id='4f4599e2206a412595f00c270561bbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7afff86-7899-480e-9dca-49050440f254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7afff86-7899-480e-9dca-49050440f254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74601848-7bb3-457d-9919-a7560738941b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74601848-7bb3-457d-9919-a7560738941b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4659d1d6-19d7-4ef1-b0f6-6737b83e677d', 'volume_name': 'volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d6813b-29ab-40c6-985d-6fe9906fd3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d6813b-29ab-40c6-985d-6fe9906fd3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f900386-1891-46a6-8e94-d0fced2b57a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:18 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume 4659d1d6-19d7-4ef1-b0f6-6737b83e677d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d', 'volume_size': 1} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Flow 'volume_create_manager' (8459ac0b-2825-4ce9-baba-7cfb9b23da43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57750621-4501-4fb6-8cda-7f0153278396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57750621-4501-4fb6-8cda-7f0153278396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1206193318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826cae44-085f-4200-951a-6e2649b83ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0d7e8117cf4f1a8f5ea07a7ca4df94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:46:19Z,use_quota=True,user_id='4f4599e2206a412595f00c270561bbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76da4792-bd91-4781-aff0-9d12a944bca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76da4792-bd91-4781-aff0-9d12a944bca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33955544-20e6-4f29-a278-ec03acb6169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33955544-20e6-4f29-a278-ec03acb6169e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '826cae44-085f-4200-951a-6e2649b83ece', 'volume_name': 'volume-826cae44-085f-4200-951a-6e2649b83ece', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a661212-a62d-4ec3-bc1a-e89c1edfbd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a661212-a62d-4ec3-bc1a-e89c1edfbd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfeadb4-e4da-428f-b664-d9fff5286e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:18 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume 826cae44-085f-4200-951a-6e2649b83ece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-826cae44-085f-4200-951a-6e2649b83ece', 'volume_size': 1} Jun 28 14:46:18 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:19 devstack sudo[115039]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8611182d-adfb-41af-b2d2-211f2a8adc27 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245" returned: 0 in 0.928s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:19 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245 is being set with open permissions: ugo+rw Jun 28 14:46:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:19 devstack sudo[115046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245 Jun 28 14:46:19 devstack sudo[115046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:19 devstack sudo[115046]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245" returned: 0 in 0.674s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:19 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:19 devstack sudo[115050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.info Jun 28 14:46:19 devstack sudo[115050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:20 devstack sudo[115050]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.info" returned: 0 in 0.683s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:20 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.info is being set with open permissions: ugo+rw Jun 28 14:46:20 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:20 devstack sudo[115054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.info Jun 28 14:46:20 devstack sudo[115054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:21 devstack sudo[115054]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.info" returned: 0 in 0.701s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.364s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.173s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-966969039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bdf5207-e46c-4e0c-941f-56f9239bcfb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0d7e8117cf4f1a8f5ea07a7ca4df94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:46:17Z,use_quota=True,user_id='4f4599e2206a412595f00c270561bbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:46:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Creating volume 7bdf5207-e46c-4e0c-941f-56f9239bcfb6 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:46:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:21 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:46:21 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:46:21 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:21 devstack sudo[115060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6 1073741824 Jun 28 14:46:21 devstack sudo[115060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:21 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ec1e56db-1b25-4769-aeef-0d440508f024 tempest-CinderUnicodeTest-360568386 None] Create snapshot completed successfully Jun 28 14:46:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Acquiring lock "cinder-45fbfb56-fce7-42da-8a5a-c107318c4245-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Lock "cinder-45fbfb56-fce7-42da-8a5a-c107318c4245-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Acquiring lock "cinder-quobyte-8611182d-adfb-41af-b2d2-211f2a8adc27" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Lock "cinder-quobyte-8611182d-adfb-41af-b2d2-211f2a8adc27" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Acquiring lock "cinder-quobyte-45fbfb56-fce7-42da-8a5a-c107318c4245" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:22 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Lock "cinder-quobyte-45fbfb56-fce7-42da-8a5a-c107318c4245" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Deleting offline snapshot 45fbfb56-fce7-42da-8a5a-c107318c4245 of volume 8611182d-adfb-41af-b2d2-211f2a8adc27 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:46:22 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] snapshot_file for this snap is: volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:46:22 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90e189d-2ae8-4e95-8178-67f1a69ecd62]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:22 devstack sudo[115060]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6 1073741824" returned: 0 in 1.018s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:22 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:22 devstack sudo[115069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245 Jun 28 14:46:22 devstack sudo[115069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:22 devstack sudo[115071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6 Jun 28 14:46:22 devstack sudo[115071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:23 devstack sudo[115071]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6" returned: 0 in 0.678s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.575s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1639046120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4680fd0-0fad-4b02-9e08-cd0249b98004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0d7e8117cf4f1a8f5ea07a7ca4df94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:46:17Z,use_quota=True,user_id='4f4599e2206a412595f00c270561bbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Creating volume b4680fd0-0fad-4b02-9e08-cd0249b98004 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:46:23 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4680fd0-0fad-4b02-9e08-cd0249b98004 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:23 devstack sudo[115077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4680fd0-0fad-4b02-9e08-cd0249b98004 1073741824 Jun 28 14:46:23 devstack sudo[115069]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:23 devstack sudo[115077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31223cd-2fbf-411d-b96f-7fec2e75229b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd47498-2db5-47b9-aac4-9db1df41a116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245" returned: 0 in 0.864s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8611182d-adfb-41af-b2d2-211f2a8adc27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:46:23 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6 (7bdf5207-e46c-4e0c-941f-56f9239bcfb6): created successfully Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd47498-2db5-47b9-aac4-9db1df41a116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Flow 'volume_create_manager' (d6898710-88b1-4f8b-b049-e0044c943a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f7fc52-9dea-4143-8278-c7f55cbfab1a]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:23 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:23 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-bd0e0bf8-4bda-408a-87fc-b1dbde7e60d0 tempest-CreateVolumesFromSnapshotTest-122782935 None] Created volume successfully. Jun 28 14:46:23 devstack sudo[115079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27 Jun 28 14:46:23 devstack sudo[115079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:24 devstack sudo[115079]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27" returned: 0 in 0.878s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:24 devstack sudo[115077]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4680fd0-0fad-4b02-9e08-cd0249b98004 1073741824" returned: 0 in 1.006s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:24 devstack sudo[115088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245 Jun 28 14:46:24 devstack sudo[115088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4680fd0-0fad-4b02-9e08-cd0249b98004 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:24 devstack sudo[115090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4680fd0-0fad-4b02-9e08-cd0249b98004 Jun 28 14:46:24 devstack sudo[115090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:24 devstack sudo[115090]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4680fd0-0fad-4b02-9e08-cd0249b98004" returned: 0 in 0.827s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.894s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-585963413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad701c2-4268-41e5-b93f-a38205582a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0d7e8117cf4f1a8f5ea07a7ca4df94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:46:18Z,use_quota=True,user_id='4f4599e2206a412595f00c270561bbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Creating volume cad701c2-4268-41e5-b93f-a38205582a78 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:46:24 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:46:24 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cad701c2-4268-41e5-b93f-a38205582a78 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:24 devstack sudo[115088]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245" returned: 0 in 0.928s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:25 devstack sudo[115097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cad701c2-4268-41e5-b93f-a38205582a78 1073741824 Jun 28 14:46:25 devstack sudo[115097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7517b04e-1fbf-44dd-8645-f674078f3922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4680fd0-0fad-4b02-9e08-cd0249b98004', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0577cdb1-895e-47ed-8cfc-d618c6d39bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:25 devstack sudo[115099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245 Jun 28 14:46:25 devstack sudo[115099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:25 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume volume-b4680fd0-0fad-4b02-9e08-cd0249b98004 (b4680fd0-0fad-4b02-9e08-cd0249b98004): created successfully Jun 28 14:46:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0577cdb1-895e-47ed-8cfc-d618c6d39bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:25 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Flow 'volume_create_manager' (a3d2bb95-6245-49b7-b5a3-33c89b7cfd64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:25 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-b7d9c20c-7a36-4500-9ee0-6301f6af9b15 tempest-CreateVolumesFromSnapshotTest-122782935 None] Created volume successfully. Jun 28 14:46:25 devstack sudo[115099]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27.45fbfb56-fce7-42da-8a5a-c107318c4245" returned: 0 in 0.705s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Lock "cinder-quobyte-45fbfb56-fce7-42da-8a5a-c107318c4245" released by "_delete_snapshot" :: held 3.521s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Lock "cinder-quobyte-8611182d-adfb-41af-b2d2-211f2a8adc27" released by "delete_snapshot" :: held 3.549s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:25 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Created reservations ['7d7695d9-3c78-4b01-811b-dbaba7e93a50', '08f198bf-bf9a-46a8-8eed-fb8668c3d719', 'acc1e5ce-bc5e-4bf6-84d6-980703ce8e8b', '5c05969c-0356-413c-9ae0-ea8b437c42a8'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:25 devstack sudo[115097]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cad701c2-4268-41e5-b93f-a38205582a78 1073741824" returned: 0 in 0.911s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:25 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Delete snapshot completed successfully. Jun 28 14:46:25 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cad701c2-4268-41e5-b93f-a38205582a78 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:25 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3eb2ff1d-6d48-46a1-bdfe-7ca8b4baf72d tempest-CinderUnicodeTest-360568386 None] Lock "cinder-45fbfb56-fce7-42da-8a5a-c107318c4245-delete_snapshot" released by "delete_snapshot" :: held 3.768s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:25 devstack sudo[115105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cad701c2-4268-41e5-b93f-a38205582a78 Jun 28 14:46:25 devstack sudo[115105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Flow 'volume_create_manager' (400e70f7-5c7f-4f77-a877-82cf29913307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23767428-8f85-41a2-a4b0-5b67778aca82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23767428-8f85-41a2-a4b0-5b67778aca82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-217901277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9704df34-301d-4e83-9cf0-4a67c9cc69d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685cd824b11b45339ade40fb92d4dae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:46:26Z,use_quota=True,user_id='4eb1ab141b5e4388ba99e9c818585f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc97144f-8e43-43f4-8daf-193d77c37efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc97144f-8e43-43f4-8daf-193d77c37efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74778072-b1f7-421c-a3e9-7776bfd2eec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74778072-b1f7-421c-a3e9-7776bfd2eec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9704df34-301d-4e83-9cf0-4a67c9cc69d0', 'volume_name': 'volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e9946e-571d-493a-b86c-9c5c75090d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e9946e-571d-493a-b86c-9c5c75090d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0172d78-0c5f-49e9-b5d5-72af74d6d322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:26 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Volume 9704df34-301d-4e83-9cf0-4a67c9cc69d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0', 'volume_size': 1} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Acquiring lock "cinder-8611182d-adfb-41af-b2d2-211f2a8adc27-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Lock "cinder-8611182d-adfb-41af-b2d2-211f2a8adc27-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Acquiring lock "cinder-quobyte-8611182d-adfb-41af-b2d2-211f2a8adc27" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Lock "cinder-quobyte-8611182d-adfb-41af-b2d2-211f2a8adc27" acquired by "delete_volume" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c655b1-90e1-4f85-9c3e-2f0a32342b48]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:26 devstack sudo[115105]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cad701c2-4268-41e5-b93f-a38205582a78" returned: 0 in 0.673s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.965s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883175563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4659d1d6-19d7-4ef1-b0f6-6737b83e677d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0d7e8117cf4f1a8f5ea07a7ca4df94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:46:18Z,use_quota=True,user_id='4f4599e2206a412595f00c270561bbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Creating volume 4659d1d6-19d7-4ef1-b0f6-6737b83e677d {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:46:26 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:26 devstack sudo[115109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d 1073741824 Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45278bb-784f-4ef5-8398-ad2a2e509f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cad701c2-4268-41e5-b93f-a38205582a78', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:26 devstack sudo[115109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe984f06-820b-4a5f-8161-45ae5fc04e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:26 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume volume-cad701c2-4268-41e5-b93f-a38205582a78 (cad701c2-4268-41e5-b93f-a38205582a78): created successfully Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe984f06-820b-4a5f-8161-45ae5fc04e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:26 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Flow 'volume_create_manager' (6e4bbb7e-71ae-4b97-b5a6-d9a37b4f69b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:26 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-208cb961-57af-45a9-b33e-1e0dc97b5d2c tempest-CreateVolumesFromSnapshotTest-122782935 None] Created volume successfully. Jun 28 14:46:26 devstack sudo[115108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27 Jun 28 14:46:26 devstack sudo[115108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:27 devstack sudo[115108]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27" returned: 0 in 0.801s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:27 devstack sudo[115119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27 Jun 28 14:46:27 devstack sudo[115119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:27 devstack sudo[115109]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d 1073741824" returned: 0 in 0.852s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:27 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:27 devstack sudo[115121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d Jun 28 14:46:27 devstack sudo[115121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:28 devstack sudo[115119]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-8611182d-adfb-41af-b2d2-211f2a8adc27" returned: 0 in 0.676s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Lock "cinder-quobyte-8611182d-adfb-41af-b2d2-211f2a8adc27" released by "delete_volume" :: held 1.537s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Created reservations ['26b102f6-2514-4cca-b79e-f4146c7e6b0d', '9319e05e-1d84-4868-9ec5-bb2043663e95', '7e65e3df-1b0b-4754-925b-f3c4f9738863', '9aa72103-a3ed-450f-bc02-31dc1419d4fe'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:28 devstack sudo[115121]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d" returned: 0 in 0.657s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.402s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1206193318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826cae44-085f-4200-951a-6e2649b83ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0d7e8117cf4f1a8f5ea07a7ca4df94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:46:19Z,use_quota=True,user_id='4f4599e2206a412595f00c270561bbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Creating volume 826cae44-085f-4200-951a-6e2649b83ece {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:46:28 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-826cae44-085f-4200-951a-6e2649b83ece 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:28 devstack sudo[115125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-826cae44-085f-4200-951a-6e2649b83ece 1073741824 Jun 28 14:46:28 devstack sudo[115125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f900386-1891-46a6-8e94-d0fced2b57a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5680dd-bf3d-4503-be40-6eee80dabbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:28 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d (4659d1d6-19d7-4ef1-b0f6-6737b83e677d): created successfully Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5680dd-bf3d-4503-be40-6eee80dabbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Flow 'volume_create_manager' (99b8ffff-3cb6-4614-b979-5dc6a4c8da26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:28 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-311c9d3e-bb8c-4359-9576-5586834806b6 tempest-CreateVolumesFromSnapshotTest-122782935 None] Created volume successfully. Jun 28 14:46:28 devstack sudo[115127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:46:28 devstack sudo[115127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Acquiring lock "cinder-e85f4531-f8c9-47f1-b16e-94781b840521-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Lock "cinder-e85f4531-f8c9-47f1-b16e-94781b840521-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Acquiring lock "cinder-quobyte-e85f4531-f8c9-47f1-b16e-94781b840521" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Lock "cinder-quobyte-e85f4531-f8c9-47f1-b16e-94781b840521" acquired by "delete_volume" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6357be-23e1-470b-bf6e-e512ce3a6a9b]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:28 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e85f4531-f8c9-47f1-b16e-94781b840521 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:28 devstack sudo[115132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e85f4531-f8c9-47f1-b16e-94781b840521 Jun 28 14:46:28 devstack sudo[115132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:29 devstack sudo[115127]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.742s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:46:29 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Deleted volume successfully. Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-6b827212-55eb-491a-a624-b8a7968cdc50 tempest-CinderUnicodeTest-360568386 None] Lock "cinder-8611182d-adfb-41af-b2d2-211f2a8adc27-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:29 devstack sudo[115125]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-826cae44-085f-4200-951a-6e2649b83ece 1073741824" returned: 0 in 0.894s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-826cae44-085f-4200-951a-6e2649b83ece {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:29 devstack sudo[115136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-826cae44-085f-4200-951a-6e2649b83ece Jun 28 14:46:29 devstack sudo[115136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:29 devstack sudo[115132]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e85f4531-f8c9-47f1-b16e-94781b840521" returned: 0 in 0.798s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e85f4531-f8c9-47f1-b16e-94781b840521 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:29 devstack sudo[115141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e85f4531-f8c9-47f1-b16e-94781b840521 Jun 28 14:46:29 devstack sudo[115141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:29 devstack sudo[115136]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-826cae44-085f-4200-951a-6e2649b83ece" returned: 0 in 0.717s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.673s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-217901277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9704df34-301d-4e83-9cf0-4a67c9cc69d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685cd824b11b45339ade40fb92d4dae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:46:26Z,use_quota=True,user_id='4eb1ab141b5e4388ba99e9c818585f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)}" {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Creating volume 9704df34-301d-4e83-9cf0-4a67c9cc69d0 {{(pid=93561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:46:29 devstack cinder-volume[93561]: INFO cinder.volume.drivers.remotefs [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] casted to osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 1073741824 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:29 devstack sudo[115144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 1073741824 Jun 28 14:46:29 devstack sudo[115144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfeadb4-e4da-428f-b664-d9fff5286e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826cae44-085f-4200-951a-6e2649b83ece', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74907323-d921-44a3-872b-8829db3b273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:29 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Volume volume-826cae44-085f-4200-951a-6e2649b83ece (826cae44-085f-4200-951a-6e2649b83ece): created successfully Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74907323-d921-44a3-872b-8829db3b273c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:29 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Flow 'volume_create_manager' (8459ac0b-2825-4ce9-baba-7cfb9b23da43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:29 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-f1f7d533-dfc8-47d9-adbd-d35e77a5a1c2 tempest-CreateVolumesFromSnapshotTest-122782935 None] Created volume successfully. Jun 28 14:46:30 devstack sudo[115141]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-e85f4531-f8c9-47f1-b16e-94781b840521" returned: 0 in 0.680s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Lock "cinder-quobyte-e85f4531-f8c9-47f1-b16e-94781b840521" released by "delete_volume" :: held 1.523s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Created reservations ['e5b4a745-8431-4bcf-a97b-12ab4ebbcb26', '60c026e9-28f2-4f96-89d1-42a3c4cbe657', '6dd74168-b119-49d4-8d32-c4c905c5a8bf', '0cbd6c2b-7727-401c-b9d6-c54762e53596'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:30 devstack sudo[115151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:46:30 devstack sudo[115151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:30 devstack sudo[115144]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 1073741824" returned: 0 in 0.818s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:30 devstack sudo[115154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 Jun 28 14:46:30 devstack sudo[115154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "cinder-826cae44-085f-4200-951a-6e2649b83ece-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-826cae44-085f-4200-951a-6e2649b83ece-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "cinder-quobyte-826cae44-085f-4200-951a-6e2649b83ece" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-826cae44-085f-4200-951a-6e2649b83ece" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2237a2-ddb9-4590-b3bd-d3027fdd66db]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:30 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-826cae44-085f-4200-951a-6e2649b83ece {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:31 devstack sudo[115156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-826cae44-085f-4200-951a-6e2649b83ece Jun 28 14:46:31 devstack sudo[115156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:31 devstack sudo[115151]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.707s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:31 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:46:31 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Deleted volume successfully. Jun 28 14:46:31 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8f5de5c0-7816-4308-8868-8bbb176bfba1 tempest-CinderUnicodeTest-360568386 None] Lock "cinder-e85f4531-f8c9-47f1-b16e-94781b840521-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:31 devstack sudo[115154]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0" returned: 0 in 0.733s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:31 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'} {{(pid=93561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 28 14:46:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0172d78-0c5f-49e9-b5d5-72af74d6d322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0', 'volume_size': 1}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a968a9f3-0b8c-4ba3-910d-a3af2977c827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:31 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Volume volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 (9704df34-301d-4e83-9cf0-4a67c9cc69d0): created successfully Jun 28 14:46:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a968a9f3-0b8c-4ba3-910d-a3af2977c827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:31 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Flow 'volume_create_manager' (400e70f7-5c7f-4f77-a877-82cf29913307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:31 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-46ae5869-d650-428b-81dc-3e4d0a93b881 tempest-SnapshotDependencyTests-940324511 None] Created volume successfully. Jun 28 14:46:31 devstack sudo[115156]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-826cae44-085f-4200-951a-6e2649b83ece" returned: 0 in 0.859s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:31 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-826cae44-085f-4200-951a-6e2649b83ece {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:31 devstack sudo[115163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-826cae44-085f-4200-951a-6e2649b83ece Jun 28 14:46:31 devstack sudo[115163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:32 devstack sudo[115163]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-826cae44-085f-4200-951a-6e2649b83ece" returned: 0 in 0.711s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:32 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-826cae44-085f-4200-951a-6e2649b83ece" released by "delete_volume" :: held 1.631s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:32 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Created reservations ['d395eebd-6df4-4c06-947a-aeb57fbb6b4e', 'a029dfa6-3b2a-4432-83c8-d6acf05c6537', '3c8d6128-f004-4938-8e77-c9672193a3ef', '46d7b210-b693-46e6-be03-c6df87e706b3'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:32 devstack sudo[115166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:46:32 devstack sudo[115166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:32 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] Creating offline snapshot f682b86e-53a2-4374-b00c-84f7ff28e324 of volume 9704df34-301d-4e83-9cf0-4a67c9cc69d0 {{(pid=93561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 28 14:46:32 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[717e047a-728e-47c2-9655-1b9c9e37f43b]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:32 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:32 devstack sudo[115168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 Jun 28 14:46:32 devstack sudo[115168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:33 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "cinder-4659d1d6-19d7-4ef1-b0f6-6737b83e677d-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:33 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-4659d1d6-19d7-4ef1-b0f6-6737b83e677d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:33 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "cinder-quobyte-4659d1d6-19d7-4ef1-b0f6-6737b83e677d" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:33 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-4659d1d6-19d7-4ef1-b0f6-6737b83e677d" acquired by "delete_volume" :: waited 0.022s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:33 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf41d51-6379-4804-8c9a-5656de5d4e1e]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:33 devstack sudo[115170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d Jun 28 14:46:33 devstack sudo[115170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:33 devstack sudo[115166]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.766s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:33 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:46:33 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Deleted volume successfully. Jun 28 14:46:33 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5bbd123e-221a-4fad-a60f-4c89535bc2cd tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-826cae44-085f-4200-951a-6e2649b83ece-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:33 devstack sudo[115168]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0" returned: 0 in 0.823s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 1G {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:33 devstack sudo[115176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 1G Jun 28 14:46:33 devstack sudo[115176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:33 devstack sudo[115170]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d" returned: 0 in 0.809s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:33 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:33 devstack sudo[115181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d Jun 28 14:46:34 devstack sudo[115181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:34 devstack sudo[115176]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 1G" returned: 0 in 0.807s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:34 devstack sudo[115186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 Jun 28 14:46:34 devstack sudo[115186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:34 devstack sudo[115181]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-4659d1d6-19d7-4ef1-b0f6-6737b83e677d" returned: 0 in 0.676s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:34 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-4659d1d6-19d7-4ef1-b0f6-6737b83e677d" released by "delete_volume" :: held 1.537s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:34 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Created reservations ['9f41b40e-90a6-4dbf-9cf0-9083ad9dd4d5', '38d9ad99-568c-4419-9893-04a76190a629', '192567ff-324f-4bf3-bdc8-19d3c6d4fdf6', '9588753b-82a1-4d57-975c-92b990061cfb'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:34 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:34 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:34 devstack sudo[115189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:46:34 devstack sudo[115189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:35 devstack sudo[115186]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 -F qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324" returned: 0 in 0.682s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:35 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 is being set with open permissions: ugo+rw Jun 28 14:46:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:35 devstack sudo[115194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 Jun 28 14:46:35 devstack sudo[115194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "cinder-cad701c2-4268-41e5-b93f-a38205582a78-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-cad701c2-4268-41e5-b93f-a38205582a78-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "cinder-quobyte-cad701c2-4268-41e5-b93f-a38205582a78" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-cad701c2-4268-41e5-b93f-a38205582a78" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:35 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cde460-c1f4-45a9-9e88-7daf79bcfbfb]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cad701c2-4268-41e5-b93f-a38205582a78 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:35 devstack sudo[115189]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.675s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:35 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:46:35 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Deleted volume successfully. Jun 28 14:46:35 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7026e73f-18b8-453a-aa7e-cb3d3b758d96 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-4659d1d6-19d7-4ef1-b0f6-6737b83e677d-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:35 devstack sudo[115197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cad701c2-4268-41e5-b93f-a38205582a78 Jun 28 14:46:35 devstack sudo[115197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:35 devstack sudo[115194]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324" returned: 0 in 0.658s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:35 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:35 devstack sudo[115200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.info Jun 28 14:46:35 devstack sudo[115200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:36 devstack sudo[115197]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cad701c2-4268-41e5-b93f-a38205582a78" returned: 0 in 0.781s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cad701c2-4268-41e5-b93f-a38205582a78 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:36 devstack sudo[115205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cad701c2-4268-41e5-b93f-a38205582a78 Jun 28 14:46:36 devstack sudo[115205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:36 devstack sudo[115200]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.info" returned: 0 in 0.689s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:36 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.info is being set with open permissions: ugo+rw Jun 28 14:46:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.info {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:36 devstack sudo[115208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.info Jun 28 14:46:36 devstack sudo[115208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:36 devstack sudo[115205]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-cad701c2-4268-41e5-b93f-a38205582a78" returned: 0 in 0.653s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:36 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-cad701c2-4268-41e5-b93f-a38205582a78" released by "delete_volume" :: held 1.489s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:36 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Created reservations ['1ee8cfff-51a0-446c-9e39-ad36099920b3', '0cc4de3b-7380-43e2-9ae6-91edca2eba67', 'f99cf8b1-3476-4fba-9055-dbadfbf39ee8', '6cd90825-3555-4c38-bf4c-aefb91a04b36'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:36 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:36 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:37 devstack sudo[115211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:46:37 devstack sudo[115211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:37 devstack sudo[115208]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.info" returned: 0 in 0.641s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.392s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:37 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-2c0ffbd5-46a9-4fb4-9b2c-751ca87c9dc4 tempest-SnapshotDependencyTests-940324511 None] Create snapshot completed successfully Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "cinder-b4680fd0-0fad-4b02-9e08-cd0249b98004-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-b4680fd0-0fad-4b02-9e08-cd0249b98004-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "cinder-quobyte-b4680fd0-0fad-4b02-9e08-cd0249b98004" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-b4680fd0-0fad-4b02-9e08-cd0249b98004" acquired by "delete_volume" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9750087c-c5ff-4138-85e2-87c609aced2f]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4680fd0-0fad-4b02-9e08-cd0249b98004 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:37 devstack sudo[115211]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.679s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:46:37 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Deleted volume successfully. Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-5d0209fd-d548-468c-89d1-d4978f931794 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-cad701c2-4268-41e5-b93f-a38205582a78-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:37 devstack sudo[115215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4680fd0-0fad-4b02-9e08-cd0249b98004 Jun 28 14:46:37 devstack sudo[115215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:37 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:37 devstack sudo[115217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:46:37 devstack sudo[115217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:38 devstack sudo[115215]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4680fd0-0fad-4b02-9e08-cd0249b98004" returned: 0 in 0.799s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4680fd0-0fad-4b02-9e08-cd0249b98004 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:38 devstack sudo[115222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4680fd0-0fad-4b02-9e08-cd0249b98004 Jun 28 14:46:38 devstack sudo[115222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:38 devstack sudo[115217]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.750s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG oslo_service.periodic_task [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] Running periodic task VolumeManager._thread_info {{(pid=93561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread count: 28 {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-a8d2c313-fdc0-4a02-b53f-65729d344ecd None None] thread info: [<_MainThread(MainThread, started 123682844258432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.flows.manager.create_volume [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Flow 'volume_create_manager' (503007d1-5f25-435c-810f-3c195654bd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1366131c-1ee3-45c8-9f5c-6b15a2284583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1366131c-1ee3-45c8-9f5c-6b15a2284583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-28T12:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a01ce79-3188-4528-b155-85e3a9f86cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685cd824b11b45339ade40fb92d4dae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-28T12:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f682b86e-53a2-4374-b00c-84f7ff28e324,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-28T12:46:39Z,use_quota=True,user_id='4eb1ab141b5e4388ba99e9c818585f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7daecc-9e02-435c-8714-0264cdcf23fe),volume_type_id=9d7daecc-9e02-435c-8714-0264cdcf23fe)' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84245253-445f-402b-a0cc-eb3d57b9f161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84245253-445f-402b-a0cc-eb3d57b9f161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a792617-99e6-4754-b37e-d0c234014515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a792617-99e6-4754-b37e-d0c234014515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3a01ce79-3188-4528-b155-85e3a9f86cf2', 'volume_name': 'volume-3a01ce79-3188-4528-b155-85e3a9f86cf2', 'volume_size': 1, 'snapshot_id': 'f682b86e-53a2-4374-b00c-84f7ff28e324'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63407ff6-2894-48f9-9396-435aa3de4b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63407ff6-2894-48f9-9396-435aa3de4b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1f1a02-b95b-4fed-b57b-14830b7bd875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:38 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Volume 3a01ce79-3188-4528-b155-85e3a9f86cf2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3a01ce79-3188-4528-b155-85e3a9f86cf2', 'volume_size': 1, 'snapshot_id': 'f682b86e-53a2-4374-b00c-84f7ff28e324'} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "cinder-quobyte-f682b86e-53a2-4374-b00c-84f7ff28e324-3a01ce79-3188-4528-b155-85e3a9f86cf2" by "_create_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-quobyte-f682b86e-53a2-4374-b00c-84f7ff28e324-3a01ce79-3188-4528-b155-85e3a9f86cf2" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Creating volume 3a01ce79-3188-4528-b155-85e3a9f86cf2 from snapshot f682b86e-53a2-4374-b00c-84f7ff28e324 {{(pid=93561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Selected osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb as target Quobyte volume. {{(pid=93561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "cinder-quobyte-3a01ce79-3188-4528-b155-85e3a9f86cf2" by "_copy_volume_from_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-quobyte-3a01ce79-3188-4528-b155-85e3a9f86cf2" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] snapshot: f682b86e-53a2-4374-b00c-84f7ff28e324, volume: 3a01ce79-3188-4528-b155-85e3a9f86cf2, {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db8f05f-8b3e-4157-8d88-81495cc3512f]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:38 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:38 devstack sudo[115225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 Jun 28 14:46:38 devstack sudo[115225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:39 devstack sudo[115222]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-b4680fd0-0fad-4b02-9e08-cd0249b98004" returned: 0 in 0.700s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-b4680fd0-0fad-4b02-9e08-cd0249b98004" released by "delete_volume" :: held 1.545s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Created reservations ['344466e8-323a-4edb-9117-429158d8b861', 'e3828a96-b00c-4a52-8b68-e57746c476dd', '807ac2dd-4b06-4bd5-893a-13a35c6bc991', '6c0760b9-7f31-4a27-8c81-f6eb25b6f8ed'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:39 devstack sudo[115228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:46:39 devstack sudo[115228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:39 devstack sudo[115225]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324" returned: 0 in 0.774s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Creating direct copy from snapshot {{(pid=93561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c83f207-f491-4830-a5a5-96ecbc77ccbf]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:39 devstack sudo[115233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 Jun 28 14:46:39 devstack sudo[115233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "cinder-7bdf5207-e46c-4e0c-941f-56f9239bcfb6-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-7bdf5207-e46c-4e0c-941f-56f9239bcfb6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "cinder-quobyte-7bdf5207-e46c-4e0c-941f-56f9239bcfb6" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-7bdf5207-e46c-4e0c-941f-56f9239bcfb6" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fba7ca-78cd-4812-9ce2-8b208a494d80]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:39 devstack sudo[115228]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.664s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:46:39 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Deleted volume successfully. Jun 28 14:46:39 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-ab16ab4c-c083-4955-bea9-7b414f1c2595 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-b4680fd0-0fad-4b02-9e08-cd0249b98004-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:40 devstack sudo[115236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6 Jun 28 14:46:40 devstack sudo[115236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:40 devstack sudo[115233]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0" returned: 0 in 0.818s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:40 devstack cinder-volume[93561]: DEBUG cinder.utils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Path /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3a01ce79-3188-4528-b155-85e3a9f86cf2 not found in is_blk_device check {{(pid=93561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 28 14:46:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3a01ce79-3188-4528-b155-85e3a9f86cf2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:40 devstack sudo[115242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3a01ce79-3188-4528-b155-85e3a9f86cf2 Jun 28 14:46:40 devstack sudo[115242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:40 devstack sudo[115236]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6" returned: 0 in 0.798s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:40 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:40 devstack sudo[115247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6 Jun 28 14:46:40 devstack sudo[115247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:41 devstack sudo[115247]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:41 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-7bdf5207-e46c-4e0c-941f-56f9239bcfb6" returned: 0 in 0.985s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:41 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-7bdf5207-e46c-4e0c-941f-56f9239bcfb6" released by "delete_volume" :: held 1.854s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:41 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Created reservations ['c7fd3ebb-7e79-420f-a0ea-30a11203572c', '12f23414-6881-4dcb-96d0-024fdf99cfae', '81cd868b-039e-4baf-be46-927956082087', '825bba1e-a8e2-4683-8fce-bae49fa86416'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:42 devstack sudo[115261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:46:42 devstack sudo[115261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "cinder-c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "cinder-quobyte-65e911ac-23f0-46ad-bee8-6e861f724e6b" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-65e911ac-23f0-46ad-bee8-6e861f724e6b" acquired by "delete_snapshot" :: waited 0.055s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "cinder-quobyte-c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Deleting offline snapshot c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f of volume 65e911ac-23f0-46ad-bee8-6e861f724e6b {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] snapshot_file for this snap is: volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e414fa02-fa6a-49f4-8d5d-da231d88d74a]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:42 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:42 devstack sudo[115263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f Jun 28 14:46:42 devstack sudo[115263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:43 devstack sudo[115261]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:43 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 1.506s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:43 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:46:43 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Deleted volume successfully. Jun 28 14:46:43 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-95eb5977-10af-4764-a947-2eb64b980156 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-7bdf5207-e46c-4e0c-941f-56f9239bcfb6-delete_volume" released by "delete_volume" :: held 3.797s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:44 devstack sudo[115263]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f" returned: 0 in 1.711s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:44 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65e911ac-23f0-46ad-bee8-6e861f724e6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:46:44 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f29050-7a8a-4949-8547-ab1850d178c1]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:44 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:44 devstack sudo[115270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b Jun 28 14:46:44 devstack sudo[115270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:45 devstack sudo[115270]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b" returned: 0 in 1.344s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:45 devstack sudo[115275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f Jun 28 14:46:45 devstack sudo[115275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:45 devstack sudo[115242]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3a01ce79-3188-4528-b155-85e3a9f86cf2" returned: 0 in 5.225s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:45 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd510558-4c04-4ece-bfd8-2c28c2fd1552]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:45 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:45 devstack sudo[115277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 Jun 28 14:46:45 devstack sudo[115277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:46 devstack sudo[115275]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f" returned: 0 in 0.757s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:46 devstack sudo[115282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f Jun 28 14:46:46 devstack sudo[115282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:46 devstack sudo[115277]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0" returned: 0 in 0.933s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:46 devstack cinder-volume[93561]: DEBUG cinder.image.image_utils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Image conversion details: src /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3a01ce79-3188-4528-b155-85e3a9f86cf2 {{(pid=93561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 28 14:46:46 devstack cinder-volume[93561]: INFO cinder.image.image_utils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Converted 1024.00 MB image at 195.94 MB/s Jun 28 14:46:46 devstack cinder-volume[93561]: WARNING cinder.volume.drivers.remotefs [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3a01ce79-3188-4528-b155-85e3a9f86cf2 is being set with open permissions: ugo+rw Jun 28 14:46:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3a01ce79-3188-4528-b155-85e3a9f86cf2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:46 devstack sudo[115287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3a01ce79-3188-4528-b155-85e3a9f86cf2 Jun 28 14:46:46 devstack sudo[115287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:46 devstack sudo[115282]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:46 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b.c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f" returned: 0 in 0.647s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f" released by "_delete_snapshot" :: held 4.666s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:46 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-65e911ac-23f0-46ad-bee8-6e861f724e6b" released by "delete_snapshot" :: held 4.721s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Created reservations ['e79d54d2-9fd9-49bb-b0c4-0164f282aaee', 'ff8d09b1-0dd9-4099-841f-3aa5f348e6e5', '8d434b7b-82da-42fe-b893-957b0dd57823', '9e6964aa-bebf-4daa-9687-99fa6a93e524'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:47 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Delete snapshot completed successfully. Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-7b3ad8c2-e48f-4a12-b24b-d5b272edeb93 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-c2c7d551-bf3e-4d78-8cb1-d7614a14ce9f-delete_snapshot" released by "delete_snapshot" :: held 4.891s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:47 devstack sudo[115287]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3a01ce79-3188-4528-b155-85e3a9f86cf2" returned: 0 in 0.673s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-quobyte-3a01ce79-3188-4528-b155-85e3a9f86cf2" released by "_copy_volume_from_snapshot" :: held 8.510s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-quobyte-f682b86e-53a2-4374-b00c-84f7ff28e324-3a01ce79-3188-4528-b155-85e3a9f86cf2" released by "_create_volume_from_snapshot" :: held 8.536s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.552s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1f1a02-b95b-4fed-b57b-14830b7bd875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a01ce79-3188-4528-b155-85e3a9f86cf2', 'volume_size': 1, 'snapshot_id': 'f682b86e-53a2-4374-b00c-84f7ff28e324'}' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441f9475-512a-4522-9f7a-f3f14ebdea45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 28 14:46:47 devstack cinder-volume[93561]: INFO cinder.volume.flows.manager.create_volume [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Volume volume-3a01ce79-3188-4528-b155-85e3a9f86cf2 (3a01ce79-3188-4528-b155-85e3a9f86cf2): created successfully Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441f9475-512a-4522-9f7a-f3f14ebdea45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG cinder.volume.manager [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Flow 'volume_create_manager' (503007d1-5f25-435c-810f-3c195654bd12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 28 14:46:47 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-77240afa-f008-46b7-ad11-176494b491b2 tempest-SnapshotDependencyTests-940324511 None] Created volume successfully. Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "cinder-65e911ac-23f0-46ad-bee8-6e861f724e6b-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-65e911ac-23f0-46ad-bee8-6e861f724e6b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "cinder-quobyte-65e911ac-23f0-46ad-bee8-6e861f724e6b" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-65e911ac-23f0-46ad-bee8-6e861f724e6b" acquired by "delete_volume" :: waited 0.016s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd192ab-1b23-4614-9333-3f1d13b4101f]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:47 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:47 devstack sudo[115327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b Jun 28 14:46:47 devstack sudo[115327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:48 devstack sudo[115327]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b" returned: 0 in 0.746s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:48 devstack sudo[115332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b Jun 28 14:46:48 devstack sudo[115332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "cinder-f682b86e-53a2-4374-b00c-84f7ff28e324-delete_snapshot" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-f682b86e-53a2-4374-b00c-84f7ff28e324-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "cinder-quobyte-9704df34-301d-4e83-9cf0-4a67c9cc69d0" by "delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-quobyte-9704df34-301d-4e83-9cf0-4a67c9cc69d0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "cinder-quobyte-f682b86e-53a2-4374-b00c-84f7ff28e324" by "_delete_snapshot" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:48 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-quobyte-f682b86e-53a2-4374-b00c-84f7ff28e324" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Deleting offline snapshot f682b86e-53a2-4374-b00c-84f7ff28e324 of volume 9704df34-301d-4e83-9cf0-4a67c9cc69d0 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 28 14:46:48 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] snapshot_file for this snap is: volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 {{(pid=93561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 28 14:46:48 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf4b7a7-f63b-4e9e-96f5-457f906fd85e]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:48 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:48 devstack sudo[115334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 Jun 28 14:46:48 devstack sudo[115334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:49 devstack sudo[115332]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-65e911ac-23f0-46ad-bee8-6e861f724e6b" returned: 0 in 0.680s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-quobyte-65e911ac-23f0-46ad-bee8-6e861f724e6b" released by "delete_volume" :: held 1.478s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Created reservations ['16e2dbae-f99c-4875-a4d2-74fca00c9d4f', '6ec71589-578d-4881-8247-326513492357', '520fa60a-e59a-46d0-8aef-6adbead8c748', 'e2e84b84-2bd4-4dfb-bb09-7ed582722111'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:49 devstack sudo[115340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:46:49 devstack sudo[115340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:49 devstack sudo[115334]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324" returned: 0 in 0.752s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.remotefs [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[713dbefe-3257-4cf8-9f41-3b8c0c64ba62]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:49 devstack sudo[115342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 Jun 28 14:46:49 devstack sudo[115342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:49 devstack sudo[115340]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.650s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:46:49 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Deleted volume successfully. Jun 28 14:46:49 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-3cba8f68-7247-41ac-ad61-3176751d9639 tempest-CreateVolumesFromSnapshotTest-122782935 None] Lock "cinder-65e911ac-23f0-46ad-bee8-6e861f724e6b-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:50 devstack sudo[115342]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0" returned: 0 in 0.785s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:50 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:50 devstack sudo[115348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 Jun 28 14:46:50 devstack sudo[115348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:51 devstack sudo[115348]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324" returned: 0 in 0.804s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:51 devstack sudo[115355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324 Jun 28 14:46:51 devstack sudo[115355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:51 devstack sudo[115355]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:51 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0.f682b86e-53a2-4374-b00c-84f7ff28e324" returned: 0 in 0.691s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-quobyte-f682b86e-53a2-4374-b00c-84f7ff28e324" released by "_delete_snapshot" :: held 3.127s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-quobyte-9704df34-301d-4e83-9cf0-4a67c9cc69d0" released by "delete_snapshot" :: held 3.150s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:51 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Created reservations ['e474e4c7-0bae-483f-a75c-b567d7c18bff', '70d97df3-cb64-492d-bc74-041af6e7d3ca', '576e8951-0c27-43ac-a5c0-f9c277275647', '5e46e203-4c5d-469b-9c71-e2153ae72a98'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:51 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Delete snapshot completed successfully. Jun 28 14:46:51 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-8204c02c-b447-4ed4-8641-4677cb12293e tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-f682b86e-53a2-4374-b00c-84f7ff28e324-delete_snapshot" released by "delete_snapshot" :: held 3.273s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "cinder-9704df34-301d-4e83-9cf0-4a67c9cc69d0-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-9704df34-301d-4e83-9cf0-4a67c9cc69d0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "cinder-quobyte-9704df34-301d-4e83-9cf0-4a67c9cc69d0" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:52 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-quobyte-9704df34-301d-4e83-9cf0-4a67c9cc69d0" acquired by "delete_volume" :: waited 0.017s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:52 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e693a51-256e-4ad9-8b25-eff7f88921e0]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:52 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:53 devstack sudo[115358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 Jun 28 14:46:53 devstack sudo[115358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:53 devstack sudo[115358]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0" returned: 0 in 0.761s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:53 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:53 devstack sudo[115363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0 Jun 28 14:46:53 devstack sudo[115363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:54 devstack sudo[115363]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-9704df34-301d-4e83-9cf0-4a67c9cc69d0" returned: 0 in 0.631s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:54 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-quobyte-9704df34-301d-4e83-9cf0-4a67c9cc69d0" released by "delete_volume" :: held 1.453s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:54 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Created reservations ['2b419d28-f6d1-4031-8ed0-e18c34269fbf', '49d404a0-ee39-45ff-8b1a-8e72a773b35d', '427d6ea5-f3c3-428e-a9a1-c7689ed73dcf', 'f7d0a72a-5ece-4ba3-bba0-ff2558a0c1df'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:54 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:54 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:54 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:54 devstack sudo[115366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:46:54 devstack sudo[115366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "cinder-3a01ce79-3188-4528-b155-85e3a9f86cf2-delete_volume" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-3a01ce79-3188-4528-b155-85e3a9f86cf2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:55 devstack sudo[115366]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.655s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:55 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:46:55 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Deleted volume successfully. Jun 28 14:46:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "cinder-quobyte-3a01ce79-3188-4528-b155-85e3a9f86cf2" by "delete_volume" {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 28 14:46:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-265b3f73-9a73-4a77-a25c-1f1535ccdcae tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-9704df34-301d-4e83-9cf0-4a67c9cc69d0-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:55 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-quobyte-3a01ce79-3188-4528-b155-85e3a9f86cf2" acquired by "delete_volume" :: waited 0.018s {{(pid=93561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 28 14:46:55 devstack cinder-volume[93561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8013d7-8fcc-4625-a0bf-31082b0ef065]: (4, 'qcow2') {{(pid=94796) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 28 14:46:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3a01ce79-3188-4528-b155-85e3a9f86cf2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:55 devstack sudo[115369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3a01ce79-3188-4528-b155-85e3a9f86cf2 Jun 28 14:46:55 devstack sudo[115369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:55 devstack sudo[115369]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3a01ce79-3188-4528-b155-85e3a9f86cf2" returned: 0 in 0.762s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:55 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3a01ce79-3188-4528-b155-85e3a9f86cf2 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:55 devstack sudo[115374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3a01ce79-3188-4528-b155-85e3a9f86cf2 Jun 28 14:46:55 devstack sudo[115374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:56 devstack sudo[115374]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13/volume-3a01ce79-3188-4528-b155-85e3a9f86cf2" returned: 0 in 0.632s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:56 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-quobyte-3a01ce79-3188-4528-b155-85e3a9f86cf2" released by "delete_volume" :: held 1.432s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:46:56 devstack cinder-volume[93561]: DEBUG cinder.quota [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Created reservations ['d3d387f7-0b5f-4cdb-b8f3-5e58b0170082', 'b6ba5ba4-c98f-43ef-9b46-9221a40bd083', '22c18994-af7a-492c-84b8-44a892bad9c1', 'ae2ad196-3293-40a6-af46-3044b496addb'] {{(pid=93561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 28 14:46:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 28 14:46:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 28 14:46:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb': None} {{(pid=93561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 28 14:46:56 devstack cinder-volume[93561]: DEBUG cinder.volume.drivers.quobyte [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-41f8abcc-bfb2-40c4-9374-59898f3621fb'] {{(pid=93561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 28 14:46:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.lockutils [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 28 14:46:56 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 28 14:46:56 devstack sudo[115377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13 Jun 28 14:46:56 devstack sudo[115377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 28 14:46:57 devstack sudo[115377]: pam_unix(sudo:session): session closed for user root Jun 28 14:46:57 devstack cinder-volume[93561]: DEBUG oslo_concurrency.processutils [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26662b4e6046af8948f0eeba93c5bf13" returned: 0 in 0.655s {{(pid=93561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 28 14:46:57 devstack cinder-volume[93561]: DEBUG cinder.manager [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Notifying Schedulers of capabilities ... {{(pid=93561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 28 14:46:57 devstack cinder-volume[93561]: INFO cinder.volume.manager [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Deleted volume successfully. Jun 28 14:46:57 devstack cinder-volume[93561]: DEBUG cinder.coordination [None req-52d46b66-493c-4be4-ba14-bc217c70b7ec tempest-SnapshotDependencyTests-940324511 None] Lock "cinder-3a01ce79-3188-4528-b155-85e3a9f86cf2-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=93561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 28 14:47:06 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=97,cinder:INSERT=38,cinder:UPDATE=154,cinder:DELETE=14 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 28 14:47:07 devstack cinder-volume[93561]: DEBUG dbcounter [-] [93561] Writing DB stats cinder:SELECT=118,cinder:INSERT=36,cinder:UPDATE=136,cinder:DELETE=9 {{(pid=93561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}